-- Logs begin at Thu 2022-07-28 01:17:09 UTC, end at Thu 2022-07-28 02:35:51 UTC. -- Jul 28 02:09:01.629286 dv-cinder-799871-46-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 02:09:01.637659 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 02:09:01 2022] *** Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: nodename: dv-cinder-799871-46-iscsi Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: machine: x86_64 Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: clock source: unix Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: pcre jit disabled Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: detected number of CPU cores: 4 Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: current working directory: / Jul 28 02:09:01.639746 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: detected binary path: /usr/bin/uwsgi-core Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: your processes number limit is 47680 Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: your memory page size is 4096 bytes Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: detected max file descriptor number: 2048 Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: lock engine: pthread robust mutexes Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: thunder lock: enabled Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 02:09:01.640456 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 02:09:01.679138 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: Python main interpreter initialized at 0x55bacbb7c9c0 Jul 28 02:09:01.679138 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: python threads support enabled Jul 28 02:09:01.679138 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: your server socket listen backlog is limited to 100 connections Jul 28 02:09:01.679138 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: your mercy for graceful operations on workers is 90 seconds Jul 28 02:09:01.679473 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 02:09:01.679550 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: *** Operational MODE: preforking *** Jul 28 02:09:01.679779 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: *** uWSGI is running in multiple interpreter mode *** Jul 28 02:09:01.679779 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: spawned uWSGI master process (pid: 103250) Jul 28 02:09:01.679967 dv-cinder-799871-46-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 02:09:01.680498 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: spawned uWSGI worker 1 (pid: 103251, cores: 1) Jul 28 02:09:01.680831 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: spawned uWSGI worker 2 (pid: 103252, cores: 1) Jul 28 02:09:01.681030 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 02:09:02.342940 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 02:09:02.343917 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 02:09:03.434170 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:09:03.434170 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: from cryptography.utils import int_from_bytes Jul 28 02:09:03.434782 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:09:03.434782 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: from cryptography.utils import int_from_bytes Jul 28 02:09:03.435323 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:09:03.435323 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 28 02:09:03.435851 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:09:03.435851 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 28 02:09:05.910655 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 02:09:05.911292 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 02:09:05.911418 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 02:09:05.911780 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 02:09:05.912036 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 02:09:05.912424 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.912746 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.913093 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.913414 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.913742 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.914053 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.914371 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.914688 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.914983 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 02:09:05.915371 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.915457 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 02:09:05.915560 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.915560 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.915758 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 02:09:05.915879 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-46-iscsi {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.916125 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 02:09:05.916215 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.916387 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 02:09:05.916481 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.916754 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.916854 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917099 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917202 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917403 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917501 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917722 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.917818 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918023 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918109 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918367 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918518 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918692 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.918969 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919077 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919278 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919367 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919578 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919665 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.919899 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920015 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920207 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920292 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-46-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920515 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920610 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920834 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.920961 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921164 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921260 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921482 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921568 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921787 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.921873 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922111 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922203 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-46-iscsi {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922421 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922529 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922827 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.922962 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.923300 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.923414 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.923648 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.923742 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.923967 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924077 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924295 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924388 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924612 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924709 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.924948 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925047 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925256 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925357 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925573 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925658 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.925895 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926074 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926221 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926366 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926502 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926637 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-46-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926801 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.926937 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927108 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927262 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927412 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927544 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927716 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.927910 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928057 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928227 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928373 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928537 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928686 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928827 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.928963 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929173 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929269 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929492 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929594 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929813 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.929910 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930063 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930198 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930311 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930439 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930626 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930772 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.930944 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931083 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931249 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931401 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931555 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931716 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.931861 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932042 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932166 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932352 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932472 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932661 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932777 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.932937 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933105 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933254 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933410 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933581 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933725 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.933907 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934035 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934233 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934353 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934488 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934658 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934744 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.934975 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935063 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935355 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935440 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935602 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935700 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935907 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.935994 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936242 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936338 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936556 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936654 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936864 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.936986 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937197 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937289 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937506 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937614 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937810 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.937895 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.938114 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.938200 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.938966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939136 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939283 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939386 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939594 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939678 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939903 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.939996 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940153 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940304 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940454 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940562 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940759 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.940893 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941100 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941245 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941407 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941569 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941713 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.941883 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942019 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942208 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942534 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942629 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942851 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.942945 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943164 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943250 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943478 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943565 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943784 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.943876 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944087 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944182 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944393 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944486 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944661 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944752 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.944994 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945084 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945306 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945393 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945633 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945793 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.945925 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946011 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946230 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946328 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946536 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946675 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946837 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.946933 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947149 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947235 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947457 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947541 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947758 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.947841 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948064 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948157 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948364 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948448 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948664 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948751 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.948995 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949094 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949308 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949394 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949611 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949706 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.949929 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950015 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950313 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950533 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950627 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950838 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.950922 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951223 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951444 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951539 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951748 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.951834 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952049 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952136 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952353 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952450 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952656 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952748 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.952988 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953089 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953293 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953389 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953590 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953677 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.953982 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.954616 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.954798 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.954897 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955122 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955209 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955428 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955515 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955741 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.955829 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.956062 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.956148 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.956376 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.956469 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.956687 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.956774 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.957040 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.957130 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.957352 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.957448 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.957661 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.957749 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.957972 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.958058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.958278 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.958372 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.958585 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.958670 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.958889 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.958985 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.959210 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.959309 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.959517 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.959609 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.959827 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.959912 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.960135 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.960229 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.960441 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.960526 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.960753 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.960844 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:09:05.961105 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.961207 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.961423 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.961512 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.961741 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.961834 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962153 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962370 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962464 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962686 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.962773 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963013 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963100 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963327 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963424 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963633 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963718 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.963963 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964057 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964280 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964367 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964599 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964686 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.964937 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965028 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965261 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965347 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965574 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965661 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965888 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.965977 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966200 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966287 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966520 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966606 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966845 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.966933 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967153 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967239 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967474 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967568 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967783 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.967876 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968095 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968182 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968406 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968501 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968718 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.968805 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.969053 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.969179 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.969390 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.969489 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.969802 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970013 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970106 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970174 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970372 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970483 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970684 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970770 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.970994 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971079 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971306 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971441 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971620 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971707 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.971927 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972014 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972232 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972327 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972537 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972623 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972846 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.972955 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973172 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973262 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973495 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973609 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973808 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.973894 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974111 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974198 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974442 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974529 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974749 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.974842 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975063 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975151 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975376 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975464 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975691 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975796 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.975997 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976084 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976311 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976397 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976619 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976712 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.976944 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977046 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977257 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977344 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977574 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977672 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977882 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.977976 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978202 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978295 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978508 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978603 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978813 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.978899 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979127 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979233 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979439 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979533 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979753 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.979845 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980067 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980155 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980379 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980466 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980688 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.980773 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981041 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981144 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981342 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981430 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981651 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981739 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.981982 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982068 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982284 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982371 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982600 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982691 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.982922 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983015 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983230 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983536 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983657 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983846 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.983950 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.984153 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.984252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.984724 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.984819 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985052 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985196 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985402 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985497 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985703 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.985811 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986005 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986103 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986309 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986409 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986615 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986756 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.986917 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987006 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987237 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987330 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987552 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987640 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987857 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.987945 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988163 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988249 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988469 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988556 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988809 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.988941 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989138 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989224 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989448 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989533 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989760 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.989849 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990075 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990169 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990384 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990484 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990694 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.990782 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991006 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991093 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991314 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991408 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991618 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991709 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.991926 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992011 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992235 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992331 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992538 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992624 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992848 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.992997 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993182 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993283 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993489 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993574 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993811 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.993909 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994120 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994209 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994438 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994533 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.994831 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995057 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995152 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995393 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995480 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995711 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.995798 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996023 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996109 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996336 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996421 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996644 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996729 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.996983 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997082 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997296 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997392 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997610 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997696 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.997916 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998003 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998315 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998546 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998646 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.998944 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999175 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999260 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999483 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999623 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999800 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:05.999886 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.000106 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.000191 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.000426 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.000526 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.000730 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.001346 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.001614 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.001701 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.001948 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002270 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002358 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002582 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002667 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002896 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.002982 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003211 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003297 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003522 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003610 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003832 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.003919 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004145 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004232 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004451 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004537 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004758 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.004845 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005094 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005182 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005411 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005498 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005722 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.005816 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006029 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006115 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006330 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006416 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006643 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006744 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.006953 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007060 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007257 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007353 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007559 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007646 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007870 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.007958 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008196 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008291 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008507 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008593 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008822 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.008936 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009158 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009251 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009459 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009544 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009762 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.009852 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010076 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010174 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010384 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010470 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010689 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010775 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.010993 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011080 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011297 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011392 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011613 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011699 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.011923 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012011 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012226 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012311 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012539 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012635 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012859 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.012989 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013193 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013280 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013508 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013595 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013820 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.013959 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014129 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014229 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014433 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014529 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014746 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.014838 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015056 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015143 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015364 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015513 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015676 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015810 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.015987 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.016121 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.016295 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.016490 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.017249 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.017385 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.017660 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.017797 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.017932 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018077 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018212 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018354 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018497 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018631 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018776 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.018918 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019064 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019199 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019415 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019618 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019836 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.019983 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020117 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020250 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020390 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020562 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020707 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.020900 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021050 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021225 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021371 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021558 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021704 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.021887 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022024 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022217 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022311 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022522 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022618 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022835 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.022930 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023141 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023227 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023445 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023539 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.023845 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.024065 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.024322 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.024409 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.024664 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.024751 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025003 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025107 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025311 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025398 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025618 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025706 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.025923 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026009 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026315 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026543 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026639 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026848 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.026935 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027163 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027305 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027467 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027564 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027790 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.027878 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028106 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028194 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028413 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028509 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028720 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.028807 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029049 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029137 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029369 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029458 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029685 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029801 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.029992 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030078 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030307 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030438 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030618 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030705 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.030928 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031022 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031241 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031334 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031551 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031636 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.031949 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.032202 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.032457 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.032546 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.032626 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.032910 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033015 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033324 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033534 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033628 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033844 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.033941 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034151 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034236 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034461 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034548 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034771 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.034868 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035076 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035164 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035384 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035471 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035689 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.035784 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036002 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036096 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036310 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036398 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036614 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036710 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.036943 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037043 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037249 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037383 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037557 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037646 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037859 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.037946 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038171 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038259 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038473 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038562 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038789 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.038876 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039090 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039176 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039394 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039481 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039696 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.039784 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040006 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040101 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040312 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040398 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040609 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040694 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.040955 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041062 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041266 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041353 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041570 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041657 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041875 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.041971 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042183 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042269 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042486 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042572 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042789 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.042885 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043095 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043180 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043412 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043497 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043718 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.043805 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044017 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044109 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044322 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044409 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044622 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044710 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.044952 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045043 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045260 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045345 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045565 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045691 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045868 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.045961 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046170 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046265 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046472 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046561 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046774 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.046880 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047073 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047170 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047378 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047459 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047829 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.047933 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048094 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048251 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048437 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048521 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048713 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.048802 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049057 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049167 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049369 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049456 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049680 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049767 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.049991 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050135 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050307 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050395 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050615 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050702 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.050923 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051012 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051231 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051318 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051539 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051633 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051840 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.051927 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052156 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052280 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052466 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052552 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052772 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.052858 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053097 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053185 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053402 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053491 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053724 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.053813 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054036 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054130 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054349 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054445 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054671 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054758 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.054993 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055079 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055315 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055408 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055617 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055702 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.055927 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056014 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056237 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056331 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056545 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056630 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056848 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.056979 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057181 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057278 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057492 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057586 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057799 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.057883 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058109 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058204 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058421 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058506 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058733 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.058820 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059038 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059133 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059352 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059449 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059654 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059741 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.059956 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060044 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060282 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060378 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060592 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060678 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.060923 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061015 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061231 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061317 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061535 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061634 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061845 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.061932 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062147 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062241 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062463 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062566 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062781 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.062878 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.063101 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.063187 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064031 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064277 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064369 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064439 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064632 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064726 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.064975 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065080 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065295 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065383 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065602 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065689 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.065987 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066083 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066301 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066394 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066612 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066706 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.066920 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067006 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067224 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067309 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067529 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067665 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067841 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.067960 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068165 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068283 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068476 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068604 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068780 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.068940 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069117 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069260 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069440 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069582 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069746 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.069906 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070069 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070231 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070484 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070580 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070797 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.070950 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071104 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071270 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071519 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071615 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071833 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.071921 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072147 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072236 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072472 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072568 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072790 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.072897 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073225 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073449 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073537 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073761 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.073847 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074068 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074154 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074393 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074487 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074700 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.074794 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075014 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075100 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075330 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075417 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075636 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075723 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.075963 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076060 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076287 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076433 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076602 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076754 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.076942 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077099 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077442 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077678 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077813 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.077990 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.078080 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.078315 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.078411 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.078638 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.078726 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.079045 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.079639 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.079908 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080145 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080238 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080319 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080516 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080613 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080822 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.080968 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081169 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081265 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081475 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081563 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081789 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.081891 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082102 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082188 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082411 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082521 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082717 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.082944 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083031 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083277 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083365 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083600 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083695 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.083929 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084022 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084244 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084332 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084558 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084766 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084893 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.084996 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085205 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085291 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085514 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085609 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085824 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.085911 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086132 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086225 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086440 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086529 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086747 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.086834 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.087062 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.087164 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.087379 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.087507 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.087694 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.088008 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.088094 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.088342 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.088649 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.088739 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089017 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089358 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089655 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089818 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.089984 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.090298 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.090411 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.090630 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.090951 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.091039 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.091265 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.091535 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.091624 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.091874 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.092101 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.092232 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.092548 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.092704 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.092927 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.093247 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.093349 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.093583 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.093791 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.093901 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.094243 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.094330 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.094614 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.094947 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.095079 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.095493 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.095581 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.095911 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.096039 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.096229 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.096541 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.096628 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.096862 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.097124 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.097214 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.097500 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.097625 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.097814 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098096 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098192 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098427 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098521 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098737 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.098824 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099046 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099142 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099366 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099453 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099675 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099760 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.099983 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100070 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100295 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100383 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100603 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100690 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.100936 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101028 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101341 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101598 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101693 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101906 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.101993 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102240 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102326 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102554 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102641 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102880 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.102967 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103196 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103335 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103515 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103611 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103830 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.103917 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104147 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104241 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104466 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104562 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104784 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.104929 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105128 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105216 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105442 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105540 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105763 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.105850 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106077 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106164 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106394 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106489 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106718 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.106955 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.107044 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.107285 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.107372 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.107600 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.107898 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108002 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108213 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108308 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108531 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108628 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.108844 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.109000 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.109179 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.109268 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.109746 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.109840 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110056 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110153 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110405 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110495 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110735 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.110856 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111178 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111382 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111487 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111718 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.111809 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112035 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112132 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112351 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112453 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112666 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.112789 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113004 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113145 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113362 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113455 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113676 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113763 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.113982 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114315 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114433 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114610 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114758 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.114924 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115073 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115235 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115395 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115546 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115718 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.115859 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116040 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116170 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116360 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116480 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116677 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.116788 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117026 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117138 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117350 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117438 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117668 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117769 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.117987 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118077 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118308 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118397 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118629 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118725 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.118958 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119053 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119288 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119374 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119613 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119804 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.119934 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.120122 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.120255 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.120454 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.120578 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.120780 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121131 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121224 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121444 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121763 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.121852 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122089 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122177 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122398 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122493 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122702 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.122792 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123013 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123100 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123323 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123410 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123628 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123717 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.123945 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124032 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124253 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124352 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124557 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124645 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124863 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.124964 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.125195 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.125302 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.125517 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.125726 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.126316 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.126617 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.126713 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.126938 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.127060 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.127264 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.127591 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.127684 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.127911 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128007 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128218 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128303 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128544 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128648 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128851 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.128974 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129179 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129267 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129495 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129583 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129808 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.129937 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130114 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130201 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130421 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130506 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130728 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.130815 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131040 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131139 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131342 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131430 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131647 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131735 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.131948 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132043 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132268 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132362 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132568 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132655 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132890 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.132981 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133194 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133299 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133506 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133601 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133811 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.133900 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134117 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134211 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134418 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134505 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134721 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.134809 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135028 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135122 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135328 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135423 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135634 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135720 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.135933 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136020 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136244 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136331 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136543 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136637 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.136850 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137005 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137180 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137497 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137584 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137807 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.137895 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.138109 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.138196 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.138758 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.138894 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139012 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139121 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139333 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139440 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139555 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139663 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139770 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.139959 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140072 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140273 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140401 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140587 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140807 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.140955 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.141171 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.141287 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144046 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144173 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144264 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144348 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144430 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144512 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144606 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144606 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144756 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144835 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.144968 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145062 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145145 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145225 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145351 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145448 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145624 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145748 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145846 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.145936 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146017 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146102 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146197 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146279 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146358 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146437 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146516 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146603 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146729 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.146848 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147040 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147141 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147350 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147521 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147661 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147750 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.147969 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148057 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148278 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148391 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148595 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148706 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.148956 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149058 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149275 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149366 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149592 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149684 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149908 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.149996 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150228 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150319 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150540 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150632 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150853 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.150943 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151211 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151307 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151469 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151570 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151782 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.151870 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152099 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152190 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152410 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152507 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152717 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.152816 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153063 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153197 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153400 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153515 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153722 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.153825 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154037 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154133 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154444 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154540 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154766 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.154856 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155091 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155179 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155406 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155540 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155723 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.155815 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156033 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156130 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156363 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156462 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156678 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.156764 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157055 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157322 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157405 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157500 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157705 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.157806 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158048 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158136 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158379 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158478 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158687 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.158775 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159002 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159087 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159312 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159399 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159618 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159712 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.159922 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160009 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160233 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160322 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160539 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160635 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.160932 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161029 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161171 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161261 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161477 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161568 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161784 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.161880 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162084 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162171 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162387 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162482 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162690 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162786 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.162995 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163081 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163300 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163385 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163599 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163694 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163906 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.163992 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164208 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164295 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164513 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164614 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164818 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.164924 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165145 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165231 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165449 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165576 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165758 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.165843 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166068 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166158 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166378 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166466 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166687 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166781 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.166999 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167085 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167318 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167406 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167628 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167723 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.167948 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168041 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168264 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168369 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168576 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168666 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.168914 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169027 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169226 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169320 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169632 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169860 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.169956 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170171 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170258 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170481 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170566 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170791 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.170888 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171103 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171190 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171414 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171500 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171731 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.171827 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.172036 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.172122 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.172355 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.172441 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173223 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173325 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173558 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173654 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173875 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.173963 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174193 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174282 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174524 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174611 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174838 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.174939 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175153 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175240 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175464 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175553 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175780 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.175881 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176095 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176184 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176414 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176503 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176728 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.176905 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177066 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177165 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177382 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177469 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177695 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.177782 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178008 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178093 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178326 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178413 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178634 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178728 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.178958 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179051 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179281 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179367 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179609 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179699 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.179926 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180013 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180257 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180352 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180583 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180671 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.180921 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181014 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181237 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181341 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181546 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181633 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.181790 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 02:09:06.181917 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.182241 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.182562 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.182881 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:09:06.183130 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 02:09:06.335932 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Registered counter for database nova_api Jul 28 02:09:06.336173 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Registered counter for database nova_api Jul 28 02:09:06.358230 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.360892 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.365789 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.367284 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.420449 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.context [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40ba2639-484f-4689-bebf-4db6b384942b(cell1) {{(pid=103251) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 02:09:06.422252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.context [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40ba2639-484f-4689-bebf-4db6b384942b(cell1) {{(pid=103252) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 02:09:06.425049 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:09:06.426613 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:09:06.426961 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:09:06.427916 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:09:06.428527 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:09:06.429335 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:09:06.431327 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:09:06.431665 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:09:06.433418 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Registered counter for database nova_cell0 Jul 28 02:09:06.434120 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Registered counter for database nova_cell0 Jul 28 02:09:06.439655 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Registered counter for database nova_cell1 Jul 28 02:09:06.440150 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Registered counter for database nova_cell1 Jul 28 02:09:06.446774 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.449048 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.451413 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.451942 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.457859 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.459637 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.586183 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.591624 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.600303 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Registered counter for database nova_cell0 Jul 28 02:09:06.602643 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Registered counter for database nova_cell0 Jul 28 02:09:06.609264 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.611472 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:09:06.614760 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.616098 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:09:06.951483 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:09:06.952777 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:09:06.959054 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:09:06.959970 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:09:07.300598 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:09:07.301660 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:09:07.306576 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:09:07.307539 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:09:07.311766 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bacbb7c9c0 pid: 103252 (default app) Jul 28 02:09:07.312723 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bacbb7c9c0 pid: 103251 (default app) Jul 28 02:09:07.314424 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:09:07.315601 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6148bcef-0941-4620-8e7d-9ab7d09fc4cd None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002318 Jul 28 02:09:07.316004 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Thu Jul 28 02:09:07 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:23.013466 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:23.015209 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002576 Jul 28 02:10:23.016781 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:23.026569 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:23.027688 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:23.028679 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell1:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:23.029606 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:23.908349 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-41b0a12a-3eb3-4cd2-938f-93725a7adae4 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:23.943633 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-41b0a12a-3eb3-4cd2-938f-93725a7adae4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922136 Jul 28 02:10:23.944360 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 2/3] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 28 02:10:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:26.198634 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:26.199850 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4ce01c68-7b0f-4c3b-82a1-6773a47ae073 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jul 28 02:10:26.200739 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 2/4] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:26.687471 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6f3ad800-3685-4095-a810-0053e494097c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:26.708212 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:10:26.708212 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 28 02:10:26.737338 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6f3ad800-3685-4095-a810-0053e494097c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.529788 Jul 28 02:10:26.738097 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 3/5] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:26.751625 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:26.752787 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell0:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:26.753778 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell1:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:26.754494 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:26.964582 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-419b9dd7-de9f-4ec1-b039-06f81a750b3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:26.969869 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:10:26.969869 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:10:27.031977 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-419b9dd7-de9f-4ec1-b039-06f81a750b3c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285990 Jul 28 02:10:27.032753 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 3/6] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 28 02:10:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:10:29.346467 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6f3ad800-3685-4095-a810-0053e494097c admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:29.347426 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6f3ad800-3685-4095-a810-0053e494097c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 28 02:10:29.347979 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 4/7] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:30.010924 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-6d478112-c88a-4f0b-b6e4-53412aa8dcca admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512, "vcpus": 1}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:30.030577 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:10:30.030577 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:10:30.051850 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-6d478112-c88a-4f0b-b6e4-53412aa8dcca admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697870 Jul 28 02:10:30.052729 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 4/8] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:10:30.064565 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a501958f-c4a1-438c-b404-e2fdbb512081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:30.067402 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:10:30.067402 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 28 02:10:30.104291 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a501958f-c4a1-438c-b404-e2fdbb512081 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043515 Jul 28 02:10:30.105096 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 5/9] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 28 02:10:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:32.368847 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-6d478112-c88a-4f0b-b6e4-53412aa8dcca admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:32.369973 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-6d478112-c88a-4f0b-b6e4-53412aa8dcca admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 28 02:10:32.370588 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:32.719589 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-f3cd9aa7-6355-4d84-b4c7-501cd92d132c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:32.739185 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-f3cd9aa7-6355-4d84-b4c7-501cd92d132c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.361956 Jul 28 02:10:32.739903 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 6/11] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:32.752016 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-9889458b-6465-4b46-8726-e8c567aa58c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:32.776760 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-9889458b-6465-4b46-8726-e8c567aa58c1 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028592 Jul 28 02:10:32.777567 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 6/12] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 28 02:10:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:10:34.982559 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-f3cd9aa7-6355-4d84-b4c7-501cd92d132c admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:34.983685 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-f3cd9aa7-6355-4d84-b4c7-501cd92d132c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Jul 28 02:10:34.984096 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 7/13] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:35.418603 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5832b16f-981c-4637-a3fb-6aef011e1cad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "swap": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:35.438408 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5832b16f-981c-4637-a3fb-6aef011e1cad admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448102 Jul 28 02:10:35.438948 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 7/14] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:35.452277 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-01ded113-68b3-4700-b8a6-83011f80f784 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:35.493774 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-01ded113-68b3-4700-b8a6-83011f80f784 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046079 Jul 28 02:10:35.494919 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 8/15] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 28 02:10:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:10:37.709989 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5832b16f-981c-4637-a3fb-6aef011e1cad admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:37.710911 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5832b16f-981c-4637-a3fb-6aef011e1cad admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 28 02:10:37.711337 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 8/16] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:38.159523 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:38.181082 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462889 Jul 28 02:10:38.184950 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 9/17] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:38.196111 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-842e2315-8d70-43ef-8297-3fd8ddbb18bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:38.221755 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-842e2315-8d70-43ef-8297-3fd8ddbb18bd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029534 Jul 28 02:10:38.222455 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 9/18] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 28 02:10:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:10:40.549659 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:40.550659 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 02:10:40.551050 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 10/19] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:40.989793 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-0199ac17-65a4-45eb-ad4b-fe7500d2da4c admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:41.015576 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-0199ac17-65a4-45eb-ad4b-fe7500d2da4c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.457005 Jul 28 02:10:41.016133 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 28 02:10:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:10:43.270506 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:43.271654 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9e7dab72-863c-40d5-bcd6-5d4ba2baa526 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Jul 28 02:10:43.272135 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 11/21] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:43.738782 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-c49f1037-0966-410d-b922-042b827c620c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:43.759051 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-c49f1037-0966-410d-b922-042b827c620c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480986 Jul 28 02:10:43.759822 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 11/22] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:10:43.774281 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-e8e42547-05f7-48e6-b3cc-ffd58393906d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:43.798652 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-e8e42547-05f7-48e6-b3cc-ffd58393906d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027977 Jul 28 02:10:43.799238 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 12/23] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 28 02:10:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:45.969280 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-c49f1037-0966-410d-b922-042b827c620c admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:45.970300 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-c49f1037-0966-410d-b922-042b827c620c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 28 02:10:45.970708 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:46.381867 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3fc0a2bb-576a-44c7-a8e1-191f0af311f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:46.401593 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-3fc0a2bb-576a-44c7-a8e1-191f0af311f5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424942 Jul 28 02:10:46.402062 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 13/25] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:46.414318 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-03203c17-4a4d-4f34-afcc-46c169853ae4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:46.438986 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-03203c17-4a4d-4f34-afcc-46c169853ae4 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028256 Jul 28 02:10:46.439553 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 13/26] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 28 02:10:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:48.652750 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3fc0a2bb-576a-44c7-a8e1-191f0af311f5 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:48.653887 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-3fc0a2bb-576a-44c7-a8e1-191f0af311f5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 28 02:10:48.654261 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:49.087254 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-1384c04f-3bad-40ed-a6bf-8ef016367c06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:49.107206 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-1384c04f-3bad-40ed-a6bf-8ef016367c06 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.446123 Jul 28 02:10:49.107567 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 14/28] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:49.119684 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-2aa2cd09-48c7-475f-a25e-68d2e361040e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:49.148093 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-2aa2cd09-48c7-475f-a25e-68d2e361040e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032202 Jul 28 02:10:49.148686 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 15/29] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 28 02:10:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:51.378887 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-1384c04f-3bad-40ed-a6bf-8ef016367c06 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:51.379886 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-1384c04f-3bad-40ed-a6bf-8ef016367c06 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 28 02:10:51.380283 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 15/30] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:10:51.832390 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-dae5cff7-8748-40bb-8f62-6ab45e145b16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:51.854590 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-dae5cff7-8748-40bb-8f62-6ab45e145b16 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468527 Jul 28 02:10:51.857378 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 16/31] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:10:51.868339 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4cf8a4ba-cf02-4382-aaa1-3cfcf97bb6fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:51.894940 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4cf8a4ba-cf02-4382-aaa1-3cfcf97bb6fa admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030148 Jul 28 02:10:51.895516 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 16/32] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 28 02:10:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:10:54.110795 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-dae5cff7-8748-40bb-8f62-6ab45e145b16 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:10:54.112069 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-dae5cff7-8748-40bb-8f62-6ab45e145b16 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 28 02:10:54.112649 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 17/33] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:10:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:10:54.555045 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:54.578819 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459711 Jul 28 02:10:54.579688 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 17/34] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 28 02:10:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:10:54.592269 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-694e4e57-1c7d-45a9-b383-c0d3a9817630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:10:54.597279 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:10:54.623685 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-694e4e57-1c7d-45a9-b383-c0d3a9817630 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035982 Jul 28 02:10:54.624281 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 18/35] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 28 02:10:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:11:14.826080 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:14.827091 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 28 02:11:14.827499 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 18/36] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:15.217647 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-bf967ce3-d4d1-4c46-99f0-5870a191ee8d admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:15.236059 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-bf967ce3-d4d1-4c46-99f0-5870a191ee8d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402545 Jul 28 02:11:15.236599 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 19/37] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 28 02:11:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:11:16.299935 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:16.300965 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-0e37348a-7eb2-4b97-8f1b-5ed259c4c1b0 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 28 02:11:16.301370 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 19/38] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:16.817810 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-d4087e4f-50c9-4d92-af62-442f812a2f71 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:16.824113 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-d4087e4f-50c9-4d92-af62-442f812a2f71 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-d4087e4f-50c9-4d92-af62-442f812a2f71 admin admin] Request method failure captured: Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Host: 10.222.0.40 Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi4fBEllmfKpZW0hi5WPqsP-EPnsGpzMWcs49Gn2NxrHQDXoeH_o0ojsuGBxTcjyOXXadU4YqmOdu7Mx9krr0pxlbVQWiMx_FxKwaEtW3liXha6XOyv3zIhxpctj_ADrur8gACuMtfXxCWx9sRPw-23y0zdawVMzz1Va974fZLBoShCuE Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Role: admin,member,reader Jul 28 02:11:16.827339 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Roles: admin,member,reader Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User: admin Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: method: > Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: exception: Flavor 42 could not be found. Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: action_args: {'id': '42'} Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:16.829071 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:16.830086 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.831531 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-d4087e4f-50c9-4d92-af62-442f812a2f71 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:16.832861 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-d4087e4f-50c9-4d92-af62-442f812a2f71 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388605 Jul 28 02:11:16.832861 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 20/39] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 28 02:11:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:16.838728 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-e2a7c01f-83f3-4976-9893-19b6528e9bc0 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:16.843627 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:11:16.863609 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-e2a7c01f-83f3-4976-9893-19b6528e9bc0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028466 Jul 28 02:11:16.864162 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 20/40] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:11:16.874016 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-43411a79-d103-44d7-9ecd-5da1de274c69 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:16.898014 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-43411a79-d103-44d7-9ecd-5da1de274c69 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027706 Jul 28 02:11:16.898540 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 21/41] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:11:16.908421 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-15ad3d42-5503-41e4-8f26-e4e3178ff3d1 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:16.915040 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-15ad3d42-5503-41e4-8f26-e4e3178ff3d1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-15ad3d42-5503-41e4-8f26-e4e3178ff3d1 admin admin] Request method failure captured: Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Host: 10.222.0.40 Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi4fBEllmfKpZW0hi5WPqsP-EPnsGpzMWcs49Gn2NxrHQDXoeH_o0ojsuGBxTcjyOXXadU4YqmOdu7Mx9krr0pxlbVQWiMx_FxKwaEtW3liXha6XOyv3zIhxpctj_ADrur8gACuMtfXxCWx9sRPw-23y0zdawVMzz1Va974fZLBoShCuE Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Role: admin,member,reader Jul 28 02:11:16.918545 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Roles: admin,member,reader Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User: admin Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: method: > Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: exception: Flavor 42 could not be found. Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: action_args: {'id': '42'} Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:16.920058 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:16.921055 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:16.922139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-15ad3d42-5503-41e4-8f26-e4e3178ff3d1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:16.923109 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-15ad3d42-5503-41e4-8f26-e4e3178ff3d1 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015151 Jul 28 02:11:16.923109 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 21/42] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 28 02:11:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 02:11:17.880497 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-43411a79-d103-44d7-9ecd-5da1de274c69 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:17.881520 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-43411a79-d103-44d7-9ecd-5da1de274c69 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 02:11:17.881913 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 22/43] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:18.408186 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-50f28de1-bda5-4c1b-996a-60ed3aa173cd admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:18.413513 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-50f28de1-bda5-4c1b-996a-60ed3aa173cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-50f28de1-bda5-4c1b-996a-60ed3aa173cd admin admin] Request method failure captured: Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Host: 10.222.0.40 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi4fBFYBJUTt4TgXDAZpirptTrur0h5bBgSxTiNgtQBRDSdtxJ77KY_T4Nl3V19t26LNCsHmc9V31UVoWkAu8oJk-fDkz3z0TMYBG1wbUauIBDZLjmMkXDD2LtVOkJeXebeflDR1YSittG5h_2vIAAVoeHjjbCgZY5boHze3j_DIWZ_v0 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Role: admin,member,reader Jul 28 02:11:18.415000 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Roles: admin,member,reader Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User: admin Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: method: > Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: exception: Flavor 84 could not be found. Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: action_args: {'id': '84'} Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:18.416604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:18.418856 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.420267 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-50f28de1-bda5-4c1b-996a-60ed3aa173cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:18.421533 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-50f28de1-bda5-4c1b-996a-60ed3aa173cd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397063 Jul 28 02:11:18.421533 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 22/44] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 28 02:11:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:18.426809 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-3b4b0902-26a1-4721-8135-fd6e7c5dfb23 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:18.442458 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-3b4b0902-26a1-4721-8135-fd6e7c5dfb23 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019207 Jul 28 02:11:18.442978 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 23/45] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:11:18.453023 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-eb5fcf3f-1e88-4d21-96ed-645389a3b327 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:18.468362 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-eb5fcf3f-1e88-4d21-96ed-645389a3b327 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019713 Jul 28 02:11:18.468895 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 23/46] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:11:18.477790 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-72119582-4fc5-45fc-830a-71f70a6a35cc admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:18.483289 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-72119582-4fc5-45fc-830a-71f70a6a35cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-72119582-4fc5-45fc-830a-71f70a6a35cc admin admin] Request method failure captured: Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Host: 10.222.0.40 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi4fBFYBJUTt4TgXDAZpirptTrur0h5bBgSxTiNgtQBRDSdtxJ77KY_T4Nl3V19t26LNCsHmc9V31UVoWkAu8oJk-fDkz3z0TMYBG1wbUauIBDZLjmMkXDD2LtVOkJeXebeflDR1YSittG5h_2vIAAVoeHjjbCgZY5boHze3j_DIWZ_v0 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Role: admin,member,reader Jul 28 02:11:18.484778 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Roles: admin,member,reader Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User: admin Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: method: > Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: exception: Flavor 84 could not be found. Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: action_args: {'id': '84'} Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:18.486263 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:18.487030 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:18.488087 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-72119582-4fc5-45fc-830a-71f70a6a35cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:18.489208 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-72119582-4fc5-45fc-830a-71f70a6a35cc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011856 Jul 28 02:11:18.489208 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 24/47] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 28 02:11:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:19.584149 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-eb5fcf3f-1e88-4d21-96ed-645389a3b327 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:19.585185 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-eb5fcf3f-1e88-4d21-96ed-645389a3b327 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 28 02:11:19.585604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 24/48] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:20.127762 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a7867a7b-ef85-43cf-9afd-6bd8b70e165b admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:20.133479 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-a7867a7b-ef85-43cf-9afd-6bd8b70e165b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a7867a7b-ef85-43cf-9afd-6bd8b70e165b admin admin] Request method failure captured: Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Host: 10.222.0.40 Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi4fBH9CV2zEWFyHSR3-2pXvXBBnOgdx298zoIuxebDCEgMgnL055o4k7EzpQGU-1egXwJddMr5pu8tR1YeGZI89Xdhhs2my5---FlzypKKZY34joINnO7wNvsBm0ZOX1Aog7k01ydN18bsjGM02M5JYETIDfDbWz-aELgEPdt3H-V4WQ Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Role: admin,member,reader Jul 28 02:11:20.134966 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Roles: admin,member,reader Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User: admin Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: method: > Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: exception: Flavor 451 could not be found. Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: action_args: {'id': '451'} Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:20.137036 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:20.137938 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.139252 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a7867a7b-ef85-43cf-9afd-6bd8b70e165b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:20.140538 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a7867a7b-ef85-43cf-9afd-6bd8b70e165b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408629 Jul 28 02:11:20.140538 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 25/49] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:11:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 02:11:20.146822 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-ebcfd0a2-41c7-4baa-9849-0fe716e4ad5d admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:20.161944 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-ebcfd0a2-41c7-4baa-9849-0fe716e4ad5d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018688 Jul 28 02:11:20.162665 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 25/50] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:11:20.172186 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:20.187403 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018760 Jul 28 02:11:20.187924 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 26/51] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 28 02:11:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:11:20.197083 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b67a8b4b-0765-45cb-8163-9f5a336d32a7 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:20.203273 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-b67a8b4b-0765-45cb-8163-9f5a336d32a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b67a8b4b-0765-45cb-8163-9f5a336d32a7 admin admin] Request method failure captured: Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Host: 10.222.0.40 Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi4fBH9CV2zEWFyHSR3-2pXvXBBnOgdx298zoIuxebDCEgMgnL055o4k7EzpQGU-1egXwJddMr5pu8tR1YeGZI89Xdhhs2my5---FlzypKKZY34joINnO7wNvsBm0ZOX1Aog7k01ydN18bsjGM02M5JYETIDfDbWz-aELgEPdt3H-V4WQ Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Role: admin,member,reader Jul 28 02:11:20.204757 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Roles: admin,member,reader Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1b3ee39e9e944a11a1450fa80f00981d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 1b3ee39e9e944a11a1450fa80f00981d Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User: admin Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Id: 84cc126dcb434ee5ab60c307b7614f62 Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: method: > Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: exception: Flavor 451 could not be found. Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: action_args: {'id': '451'} Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:11:20.206316 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:20.207355 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 28 02:11:20.208743 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b67a8b4b-0765-45cb-8163-9f5a336d32a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:11:20.209983 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b67a8b4b-0765-45cb-8163-9f5a336d32a7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012614 Jul 28 02:11:20.209983 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 26/52] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:11:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 02:11:21.169535 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:21.170543 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 28 02:11:21.170970 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 27/53] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:11:21.690240 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5ed2ba70-b0e7-477e-948b-4e618f6007da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:11:21.710205 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5ed2ba70-b0e7-477e-948b-4e618f6007da admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402306 Jul 28 02:11:21.710769 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 27/54] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 28 02:11:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:11:22.707107 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:22.708117 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 28 02:11:22.708514 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 28/55] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:23.232664 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-32f89f99-eaab-4132-bef5-d6735e5c1c1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:11:23.253025 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-32f89f99-eaab-4132-bef5-d6735e5c1c1c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405257 Jul 28 02:11:23.253574 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 28/56] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 28 02:11:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:11:24.251131 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:24.252131 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 28 02:11:24.252534 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 29/57] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:24.779242 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-46796986-4248-46c7-9eef-4d97c8b6c74c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:11:24.798045 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-46796986-4248-46c7-9eef-4d97c8b6c74c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404969 Jul 28 02:11:24.798579 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 29/58] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 28 02:11:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:11:25.778478 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:25.779492 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 28 02:11:25.779892 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 30/59] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:26.301718 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-d5631059-6762-469a-bc7d-1384dee818bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:11:26.320337 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-d5631059-6762-469a-bc7d-1384dee818bb admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398764 Jul 28 02:11:26.320892 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 30/60] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 28 02:11:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:11:27.292898 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:27.293915 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 28 02:11:27.294310 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 31/61] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:11:27.817848 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-9a193b24-6d1b-4a70-ad06-c7db39a0f5eb admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:11:27.839615 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-9a193b24-6d1b-4a70-ad06-c7db39a0f5eb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409719 Jul 28 02:11:27.840310 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 31/62] 10.222.0.40 () {60 vars in 1202 bytes} [Thu Jul 28 02:11:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:12:19.371789 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.372835 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4e55825a-cf4d-48f3-82f0-7438453341e6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 28 02:12:19.373261 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 32/63] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:12:19.383981 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:19.763490 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-561e3948-3661-4115-b055-b0362e119111 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.784028 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-561e3948-3661-4115-b055-b0362e119111 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405083 Jul 28 02:12:19.784505 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 32/64] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:12:19.807624 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-ffd150da-c851-4893-9f19-14562d197a3f admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.811202 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:12:19.817519 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-ffd150da-c851-4893-9f19-14562d197a3f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013494 Jul 28 02:12:19.818063 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 33/65] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:12:19.829958 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-9efbe49a-8cb5-4cf6-be70-177a7dd63cf0 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.838343 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-9efbe49a-8cb5-4cf6-be70-177a7dd63cf0 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011972 Jul 28 02:12:19.838861 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 33/66] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:12:19.851122 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.859318 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012524 Jul 28 02:12:19.859849 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 34/67] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:12:19.871318 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-f712cb4e-353f-4e0a-b4a6-ef00f2c5564e admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:12:19.878920 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-f712cb4e-353f-4e0a-b4a6-ef00f2c5564e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011220 Jul 28 02:12:19.879435 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 34/68] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 28 02:12:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:15:58.420467 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:15:58.421526 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 28 02:15:58.421982 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 35/69] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:15:58.573714 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=6 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:15:58.739330 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:15:58.741730 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:15:58.741730 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:15:58.742938 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:15:58.743376 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:15:58.744158 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:15:58.745930 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:15:58.781064 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-27d16b0b-535f-41ab-92b3-8f19d7a1b22e admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.209203 Jul 28 02:15:58.781634 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 35/70] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:15:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:15:59.637657 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:15:59.638665 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 28 02:15:59.639077 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 36/71] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:15:59.838409 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:15:59.840914 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:15:59.840914 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:15:59.842481 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:15:59.842859 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:15:59.843658 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:15:59.844084 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:15:59.864728 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-7d302c05-916f-4373-a272-b1ee55a84506 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084488 Jul 28 02:15:59.865530 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 36/72] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:15:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:16:11.145446 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:16:11.146381 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 28 02:16:11.146777 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 37/73] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:16:11.297475 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell0:SELECT=4 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:11.298197 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell1:SELECT=4 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:11.298806 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=8 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:16:11.349750 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:16:11.352166 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:16:11.352166 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:16:11.354085 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:16:11.354604 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:16:11.355462 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:16:11.355947 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:16:11.381546 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-9cd29dce-6e30-4ba3-a896-cbf5bcd65a78 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088405 Jul 28 02:16:11.382128 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 37/74] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:16:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:16:12.246061 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:16:12.247091 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c3d6bd75-acc6-4843-9117-12efba3a2e39 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 28 02:16:12.247498 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 38/75] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 28 02:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:16:12.444494 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:16:12.447139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 02:16:12.447139 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 28 02:16:12.448470 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:16:12.448934 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:16:12.449729 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:16:12.450222 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:16:12.472718 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-70980bc7-8a04-4e5b-b456-f465f0ff722b admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082641 Jul 28 02:16:12.473322 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 38/76] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 28 02:16:12 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:17:07.168690 dv-cinder-799871-46-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 02:17:07.170174 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: Thu Jul 28 02:17:07 2022 - graceful shutdown triggered... Jul 28 02:17:07.170880 dv-cinder-799871-46-iscsi devstack@n-api.service[103251]: Gracefully killing worker 1 (pid: 103251)... Jul 28 02:17:07.171478 dv-cinder-799871-46-iscsi devstack@n-api.service[103252]: Gracefully killing worker 2 (pid: 103252)... Jul 28 02:17:08.170760 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: worker 1 buried after 1 seconds Jul 28 02:17:08.171264 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: worker 2 buried after 1 seconds Jul 28 02:17:08.171264 dv-cinder-799871-46-iscsi devstack@n-api.service[103250]: goodbye to uWSGI. Jul 28 02:17:08.172359 dv-cinder-799871-46-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 02:17:08.172932 dv-cinder-799871-46-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 02:17:08.176396 dv-cinder-799871-46-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 02:17:08.188999 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 02:17:08 2022] *** Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: nodename: dv-cinder-799871-46-iscsi Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: machine: x86_64 Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: clock source: unix Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: pcre jit disabled Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: detected number of CPU cores: 4 Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: current working directory: / Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: detected binary path: /usr/bin/uwsgi-core Jul 28 02:17:08.190873 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: your processes number limit is 47680 Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: your memory page size is 4096 bytes Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: detected max file descriptor number: 2048 Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: lock engine: pthread robust mutexes Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: thunder lock: enabled Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 02:17:08.192143 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 02:17:08.232477 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: Python main interpreter initialized at 0x55e7d93ec9c0 Jul 28 02:17:08.232477 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: python threads support enabled Jul 28 02:17:08.232477 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: your server socket listen backlog is limited to 100 connections Jul 28 02:17:08.232477 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: your mercy for graceful operations on workers is 90 seconds Jul 28 02:17:08.232984 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 02:17:08.232984 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: *** Operational MODE: preforking *** Jul 28 02:17:08.233213 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: *** uWSGI is running in multiple interpreter mode *** Jul 28 02:17:08.233213 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: spawned uWSGI master process (pid: 117771) Jul 28 02:17:08.233424 dv-cinder-799871-46-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 02:17:08.235133 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: spawned uWSGI worker 1 (pid: 117787, cores: 1) Jul 28 02:17:08.235133 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: spawned uWSGI worker 2 (pid: 117788, cores: 1) Jul 28 02:17:08.235133 dv-cinder-799871-46-iscsi devstack@n-api.service[117771]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 02:17:08.917594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 02:17:08.921243 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 02:17:10.128705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:17:10.128705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Jul 28 02:17:10.129445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:17:10.129445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Jul 28 02:17:10.270130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:17:10.270130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Jul 28 02:17:10.270768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 02:17:10.270768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Jul 28 02:17:12.680387 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 02:17:12.681019 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 02:17:12.681300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 02:17:12.681578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 02:17:12.681834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 02:17:12.682228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.682557 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.682889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.683214 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.683545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.683855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.684185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.684511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.684842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.685133 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.685459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.685779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-46-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.686102 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.686592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.686910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.687351 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.687661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.687988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.688298 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.688917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.692175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.692175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.692175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.692524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-46-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.698382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.699665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.700048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.700129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.700435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.700718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.700970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.701241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.701569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.702228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.702228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.702502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.702644 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.702948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.703322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.703600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.704087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.704229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.705395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.705395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.705959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.706445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.706596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.707096 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.707256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.707523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.708014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.708512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.709160 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.709407 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.709905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.710296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.710582 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.710899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.711219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.711543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.711854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.712166 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.712474 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.712795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.713150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.713466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.713715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.714115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.714377 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.714637 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.714945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.715254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.715562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.715862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.716169 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.716476 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.716787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.717308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.717478 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.717816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.718072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.718809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.718809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.719123 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.719426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.719648 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.720078 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.720413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.720723 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.721071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.721381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.721692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.722542 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.722542 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.722737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.722905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.723395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.723713 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.724031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.724338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.724657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.724994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.725307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.725611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.725917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.726224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.726529 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.726834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.727666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.727666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.727871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.728065 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.728362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.728725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.729179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.729288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.729614 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.729957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.730289 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.730632 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.730948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.731283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.731620 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.731936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.732248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.732575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.732920 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.733239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.733554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.733921 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.734184 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.734508 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.734838 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.735148 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.735471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.735789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.736134 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.737016 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.737016 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.737271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.737674 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.737854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.738198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.738514 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.739006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.739194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.739722 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.739891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.740070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.740400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.740742 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.741084 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.741406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.741720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.742033 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.742346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.742659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.742976 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.743329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.743650 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.744082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.744285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.744671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.745026 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.745248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.745562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.747891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.748160 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.748328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.748765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.749049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.749197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.749921 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.749921 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.750271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.750405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.750715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.751037 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.751345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.752358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.752527 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.752796 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.753331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.754369 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.754369 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.754369 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.754747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.754960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.755217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.755531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.755847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.756187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.756526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.756833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.757256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.757516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.757828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.758132 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.758447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.758776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.759060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.759364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.759789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.760117 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.760284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.760587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.760939 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.761213 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.761551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.761861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.762168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.762526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.762777 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.763130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.763434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.763842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.764126 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.764448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.764773 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.765362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.765481 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.765786 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.766103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.766420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.766734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.767055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.767439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.767758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.768070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.768396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.768709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.769142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.769443 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.769780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.770099 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.770440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.770779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.771127 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.771481 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.771745 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.772044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.772357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.772667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.773052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.773379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.773689 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.773956 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.774266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.774592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.774899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.775219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.775539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.775833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.776534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.776887 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.777210 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.777520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.777844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.778154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.778463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.778776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.779082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.779386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.779694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.780011 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.780323 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.780631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.780953 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.781285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.781389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 02:17:12.782015 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 02:17:12.782125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.782125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.782299 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 02:17:12.782399 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.782485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 02:17:12.782581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.782665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 02:17:12.783325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.783728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.783862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.783862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.784027 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.784848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.784968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.785057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.785139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.785211 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.785342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.785510 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.786080 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.786164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.786236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.786305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.786383 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.786464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.786544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.786544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.786680 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.786758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.787906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.787996 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-46-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788074 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788154 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.788854 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.788969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.789051 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.789285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.789456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.789591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.789903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.790044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.790128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.790201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.790496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.790591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.790685 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.790891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.791025 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.791115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.791468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.791573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.791648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.791719 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.791965 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.792054 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.792275 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.792357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.793069 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.793160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.793233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.793312 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.793391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.793478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-46-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.793590 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.793674 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.793944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.794056 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.794258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.794359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.800356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.802102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.802102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.802336 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.802427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.802532 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.802626 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.802718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.802803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.802893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.802984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.803077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.803247 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.803403 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803476 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.803554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803631 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.803709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.803976 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.804103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.804232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.804361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.804473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.804473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.804473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.804826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.804826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.805400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.805495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.805580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.805661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.805732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.805802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.805871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.805949 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806099 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806576 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.806914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.806990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807061 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807208 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807354 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807503 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.807956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.807956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808411 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808647 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808726 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808804 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.808971 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.808971 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.809131 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.809213 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.809293 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.810367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.810490 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.810570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.810643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.810730 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.810813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.810896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.810969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811205 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811439 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811686 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.811837 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811837 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.811964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812390 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.812866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.812866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.813052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.813131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.813204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.813274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.813358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.813431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.813502 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.813603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.813691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.814014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.814639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.814731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.815117 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.815217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.815298 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.815379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.815589 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.815702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.815918 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.816034 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.816263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.816372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.816530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.816633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.816834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.816963 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.817168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.817262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.817473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.817567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.817776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.817877 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.818084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.818186 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.818396 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.818497 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.818708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.818807 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.819009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.819107 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.819322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.819414 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.819627 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.819720 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.820138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.820252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.820357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.820661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.820772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.820863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.820966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.821052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.821170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.821282 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.821414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.821509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.821721 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.821944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.822057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.822166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.822335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.822440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.822645 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.822757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.822948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.823076 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.823248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.823395 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.823549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.823642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.823856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.823982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.824164 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.824271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.824471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.824574 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.824776 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.824965 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.825108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.825205 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.825413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.825518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.825732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.825827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.826051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.826151 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.826359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.826450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.826661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.826753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.826968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.827060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.827278 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.827374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 02:17:12.827592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.827687 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.827896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.827990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.828947 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.829166 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.829277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.829485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.829578 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.830364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.830533 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.830734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.830856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832273 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.832911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833001 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833446 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833782 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.833969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834063 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834220 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834454 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.834771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.835092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.835395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.835615 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.835780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.835960 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.836107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.836277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.836495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.836645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.836819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.837229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.837441 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.837604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.837779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.838988 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.839149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.839322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.839577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.839725 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.840041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.840201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.840452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.840835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.841233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.841418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.841684 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.841778 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.842105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.842236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.842436 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.842710 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.842817 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.843086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.843200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.843441 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.843637 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.843771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.844076 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.844196 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.844416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.844554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.845016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.845294 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.845700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.845819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.846980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.847125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.847291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.847611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.847709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.847925 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.848086 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.848254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.848519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.848617 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.850047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.850184 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.850803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.850948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851324 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851752 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851851 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.851851 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852020 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852528 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.852702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853255 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853836 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.853948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.854153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.854333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.854473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.854756 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.854848 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.855094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.855225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.855425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.855654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.855745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.856962 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.857087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.857399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.857515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.857727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.857970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.858071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.858346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.858471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.858661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.858926 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.859024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.859268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.859539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.859640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.859888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.860055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.860177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.860484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.860574 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.860791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861479 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861807 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.861969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.862125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.862400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.862498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.862727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.862893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.863037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.863328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.863420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.863690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.863801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.864036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.864246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.864377 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865803 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.865895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866058 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866579 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866864 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.866954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.867188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.867404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.867498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.867811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.867967 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.868125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.868422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.868532 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.868751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.868955 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.869115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.869409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.869514 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.869734 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.869918 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.870079 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.870353 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.870451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.870722 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.870858 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871397 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.871979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.872221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.872311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.872768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.872933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873044 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873286 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.873869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.874117 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.874215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.874493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.874639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.874808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.875097 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.875198 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.875424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.875598 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.875743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.876062 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.876162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.876394 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.877119 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.877262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.877573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.877673 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878367 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.878986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.879081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.879298 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.879515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.879607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.879908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.880010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.880235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.880438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.880550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.880865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881050 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881197 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881817 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.881924 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.882124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.882296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.882433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.882726 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.882818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.883058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.883232 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.883372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.883654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.883745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884320 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884691 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.884962 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.885111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.885278 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.885550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.885651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.885882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.886044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.886204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.886473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.886630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.886833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.887010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.887139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.887422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.887563 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.887762 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.888152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.888315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.888466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.888596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.888736 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889015 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.889968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.890174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.890324 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.890591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.890744 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.890889 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.891125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.891229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.891518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.891685 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.891822 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.892065 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.892858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.893072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.893223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.893348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.893686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.893917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.894019 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.894395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.894511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.894840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.894933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.895157 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.895346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.895482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.895795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.895894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.896114 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.896301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.896447 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.896751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.896860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.897138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.897452 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.897576 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.897767 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898692 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.898781 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899009 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899421 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899763 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.899938 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.900837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901272 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901491 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.901891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902114 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902205 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.902842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903362 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903465 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903668 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903782 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.903979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904628 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.904973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905618 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.905931 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906029 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906864 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.906972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.907173 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.907288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.907477 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.907569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.907816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908003 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908261 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908634 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.908728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909155 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.909758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910244 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910354 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.910905 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911524 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.911952 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.912087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.912408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.912507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.912732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.913785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.914959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915273 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915589 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915848 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.915967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916231 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.916866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917364 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.917869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918398 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918724 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.918831 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919122 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919439 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919739 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.919956 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920107 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.920989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.921211 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.921318 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.921521 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.921626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.921830 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922173 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922718 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.922808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923349 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923506 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923682 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923766 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.923996 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924090 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924458 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924722 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.924936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925034 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925244 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.925866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926273 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926563 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.926781 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.927682 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.927826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.927909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.928549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929136 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.929990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930727 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.930896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.931286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.931730 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.931906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932264 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.932823 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.933168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.933168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.933536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.933706 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.933865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934261 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934423 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934535 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934715 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934807 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.934991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935380 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.935988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936073 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936165 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936349 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936432 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.936846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937318 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937409 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.937917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938352 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938352 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.938824 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.939731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.939844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.939844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940683 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.940951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.941089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.941260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.941498 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.941695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.941838 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942763 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.942944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.943059 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.943296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.943711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.943711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.944125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.944456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.945085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.945242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.945398 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.945545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946105 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946269 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.946861 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947435 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947527 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947854 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.947940 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948032 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948437 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.948917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949636 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.949953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950615 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.950935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951371 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.951836 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952079 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952481 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.952746 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953019 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953133 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.953982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.954184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.954310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.954521 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.954653 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.955454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.955751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.955870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956173 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956693 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.956787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957159 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957512 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.957978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.958909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.959978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960723 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.960974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961292 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961810 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.961916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962122 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962535 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962742 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.962855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963106 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.963815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964037 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964366 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964480 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964674 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.964764 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965469 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965723 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.965840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.966004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.966453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.966637 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.966759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.966759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.967032 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.967118 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.967212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.967392 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.967920 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.968074 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.968347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.969029 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.969319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.969666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.970104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.970811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.971042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.971145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.971569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.971752 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.972000 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.972432 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.972586 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.972779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.972929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973862 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.973956 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974428 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974776 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.974957 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.975583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.976024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.976205 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.976502 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.976823 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.977164 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.977487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.977809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.978129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.978770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.979192 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.979358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.979773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.979998 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.980319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.980639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.980992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.981328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.981625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.981943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.982279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.982607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.982939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.983284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.983608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.983928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.984248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.984568 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.984955 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.985281 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.985595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.985938 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.986791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.986984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.987224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.987474 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.987794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.988112 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.988431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.988744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.989091 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.989413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.989745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.990088 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.990417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.990837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.991148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.991379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.991945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.992271 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.992611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.992974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.995769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.996067 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.996384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.996697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.997045 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.997362 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.997941 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.998280 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.998603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.998936 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.999267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.999589 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:12.999901 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.000231 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.000553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.000864 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.001380 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.002090 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.002408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.002681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.003001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.003317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.003629 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.003945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.004254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.004587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.004920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.005235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.005544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.005862 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.006173 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.006480 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.006791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.007098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.007412 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.007719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.008035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.008348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.008658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.008991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.009314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.009761 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.009994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.010306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.010618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.010944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.011586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.011750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.011996 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.012315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.012670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.013018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.013591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.013928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.014253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.014596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.014934 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.015242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.015548 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.015856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.016188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.016506 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.016821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.017168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.018309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.018808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.019143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.019526 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.019760 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.020304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.020838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.020838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.021308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.021546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.022086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.022360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.022712 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.023043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.023368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.023692 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.024017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.025917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.026238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.026550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.026988 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.027308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.027634 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.027961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.028278 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.028603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.028954 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.029272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.029597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.029914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.030245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.030591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.030924 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.031262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.031570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.031976 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.032187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.032500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.032907 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.033199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.033707 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.034019 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.034340 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.034651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.034964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.035276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.035585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.035900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.036209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.036519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.036827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.037051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Registered counter for database nova_api Jul 28 02:17:13.037201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.037479 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.037787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.038102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.038412 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.038721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.039029 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.039340 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.039647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.039987 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.040326 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.040648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.040999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.041327 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.041652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.041968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.042300 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.042619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.042988 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.043251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.043591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.043906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.044225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.044543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.044861 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.045209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.045526 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.045859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.046193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.046508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.046838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.047160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.047485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.047804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.048119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.048991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.049309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.049662 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.049989 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.050304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.050615 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.050935 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.051254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.051575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.051897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.052267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.052557 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.052906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.053217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.053546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.053878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.054240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.054560 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.054916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.055252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.055573 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.055892 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.056205 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 02:17:13.056452 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 02:17:13.058966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.066357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.119400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Registered counter for database nova_api Jul 28 02:17:13.123654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.context [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40ba2639-484f-4689-bebf-4db6b384942b(cell1) {{(pid=117787) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 02:17:13.132629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:17:13.134274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:17:13.135092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:17:13.137162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:17:13.139231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Registered counter for database nova_cell0 Jul 28 02:17:13.141142 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.143883 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Registered counter for database nova_cell1 Jul 28 02:17:13.151974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.153623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.154409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.162534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.162864 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.207638 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.context [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40ba2639-484f-4689-bebf-4db6b384942b(cell1) {{(pid=117788) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 02:17:13.211721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:17:13.213325 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:17:13.214125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:17:13.216158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:17:13.218195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Registered counter for database nova_cell0 Jul 28 02:17:13.222719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Registered counter for database nova_cell1 Jul 28 02:17:13.233086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.234400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.243316 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.243729 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.323784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Registered counter for database nova_cell0 Jul 28 02:17:13.330911 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.335625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.403681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Registered counter for database nova_cell0 Jul 28 02:17:13.411969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 02:17:13.417509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 02:17:13.670539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:17:13.679115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:17:13.757597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:17:13.765068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:17:14.040353 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:17:14.047709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-44244c0b-1f88-4f2e-a3cb-7763b0ba3167 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:17:14.055068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7d93ec9c0 pid: 117787 (default app) Jul 28 02:17:14.121866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 02:17:14.128740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-1d0d5382-e5b6-411a-9f4a-dcda008cc3f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 02:17:14.134225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e7d93ec9c0 pid: 117788 (default app) Jul 28 02:17:59.763820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:59.764731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:59.765682 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:17:59.766841 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:00.264774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7f5acaa6-d613-4180-b140-18d22a1eda95 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58d638b0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:01.499549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7f5acaa6-d613-4180-b140-18d22a1eda95 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/67896faa-f813-490f-9796-4fb63618e797" status: 200 len: 351 microversion: 2.1 time: 1.760431 Jul 28 02:18:01.500958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 1/1] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:17:59 2022] GET /compute/v2.1/os-volumes/67896faa-f813-490f-9796-4fb63618e797 => generated 351 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:03.846046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-40a6fb7c-08eb-4939-990e-3ffc17c3fbf6 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58e49820>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:03.876402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:03.878262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:03.879338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:03.880149 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:04.792082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-40a6fb7c-08eb-4939-990e-3ffc17c3fbf6 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/d6e3ea09-7db2-428a-838d-e9711898bac2" status: 200 len: 351 microversion: 2.1 time: 1.196200 Jul 28 02:18:04.793042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 1/2] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:18:03 2022] GET /compute/v2.1/os-volumes/d6e3ea09-7db2-428a-838d-e9711898bac2 => generated 351 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:07.607388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ebf22334-f58d-46f1-8fe7-c002a0a23ccc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: .version_select at 0x7efc58c28a60>, body: {"keypair": {"name": "tempest-keypair-445458978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWzdD2mXWVSJM0j6oUBZHkewNmMY+qiCnSzbMjwYh9GLB1qdmQ9HfMPBjM0TcUTrEMB8s8IYbSlgO3LunTfi1lZtmms1jrJ4T7v48EsLQNE9UbEBi3GlQ1rjmWp3+qMTA=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:07.738938 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-ebf22334-f58d-46f1-8fe7-c002a0a23ccc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for project 1ed45da3e0024fa597d03299abae9859. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:18:07.765230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-ebf22334-f58d-46f1-8fe7-c002a0a23ccc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for user 67ffe17468b04aa6ab148a976b5464b4 and project 1ed45da3e0024fa597d03299abae9859. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:18:07.891966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ebf22334-f58d-46f1-8fe7-c002a0a23ccc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.607536 Jul 28 02:18:07.893233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 2/3] 10.222.0.40 () {62 vars in 1200 bytes} [Thu Jul 28 02:18:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 610 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 02:18:08.941768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e6662c8-85d5-4fa1-8436-ebb8cc004338 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58c99b80>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:09.046283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e6662c8-85d5-4fa1-8436-ebb8cc004338 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8bf5290a-5fe0-4a5c-86c6-57a547f3e176" status: 200 len: 349 microversion: 2.1 time: 0.109344 Jul 28 02:18:09.046848 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:18:08 2022] GET /compute/v2.1/os-volumes/8bf5290a-5fe0-4a5c-86c6-57a547f3e176 => generated 349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:09.061887 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a2e7d3b-8c16-40b8-8d19-ae024a36cedb tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58bd3820>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:09.296506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a2e7d3b-8c16-40b8-8d19-ae024a36cedb tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.238353 Jul 28 02:18:09.297500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 3/5] 10.222.0.40 () {58 vars in 1134 bytes} [Thu Jul 28 02:18:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:09.318480 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-193fd3ee-5f68-4e91-b529-3ef77bcc4e51 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58c99d30>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:09.556619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-193fd3ee-5f68-4e91-b529-3ef77bcc4e51 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.242612 Jul 28 02:18:09.557709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 3/6] 10.222.0.40 () {58 vars in 1149 bytes} [Thu Jul 28 02:18:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:09.572137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7d405f51-d063-46e7-9e3e-50d8735e0073 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc583940d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:09.757217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7d405f51-d063-46e7-9e3e-50d8735e0073 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.189822 Jul 28 02:18:09.758290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1134 bytes} [Thu Jul 28 02:18:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:09.771202 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a029722-3e9e-4fbd-8b35-a2b569b723ca tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58c99940>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:10.029548 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a029722-3e9e-4fbd-8b35-a2b569b723ca tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.262176 Jul 28 02:18:10.030512 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1167 bytes} [Thu Jul 28 02:18:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:10.047012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-be8c5e58-b347-40b7-a0a5-7abb32fd3b0d tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58394dc0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:10.410348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-be8c5e58-b347-40b7-a0a5-7abb32fd3b0d tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.368984 Jul 28 02:18:10.411071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 5/9] 10.222.0.40 () {58 vars in 1170 bytes} [Thu Jul 28 02:18:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:18:10.428232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c242e4a9-7c1f-471c-ac7f-ead321f9b3dd tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58be5dc0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:10.728065 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c242e4a9-7c1f-471c-ac7f-ead321f9b3dd tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.306655 Jul 28 02:18:10.729385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 5/10] 10.222.0.40 () {58 vars in 1155 bytes} [Thu Jul 28 02:18:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:10.743309 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2f38257e-ee9e-4c93-9d99-87cf2eb36e93 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc583899d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:10.993107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2f38257e-ee9e-4c93-9d99-87cf2eb36e93 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.253707 Jul 28 02:18:10.993925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 6/11] 10.222.0.40 () {58 vars in 1188 bytes} [Thu Jul 28 02:18:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:11.014826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00edc17e-4f9a-44b7-9002-8539822a43e3 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] Calling method '.version_select at 0x7efc58c07040>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:11.217650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00edc17e-4f9a-44b7-9002-8539822a43e3 tempest-VolumesTestJSON-185884988 tempest-VolumesTestJSON-185884988-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212387 Jul 28 02:18:11.234457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1155 bytes} [Thu Jul 28 02:18:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:15.230182 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1352435628", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "networks": [{"uuid": "1945b63c-bc56-48e7-a890-1321d0b15d6d"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:15.389420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] validate_networks() for [('1945b63c-bc56-48e7-a890-1321d0b15d6d', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:18:16.922002 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:18:16.922514 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:18:16.922748 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:18:16.923167 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:18:16.923583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:18:16.941575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:16.942270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:16.943303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:16.943871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:16.977141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Getting quotas for project a042e3701d7842b29f4f3caddc8dd0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:18:16.993925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Getting quotas for user 11107befbd514c76844b15204ca45413 and project a042e3701d7842b29f4f3caddc8dd0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:18:17.007742 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:18:17.011308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:18:17.136106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bee568b3-3100-45a4-a4de-827a1b318f55 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.160828 Jul 28 02:18:17.146063 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 7/13] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:18:17.171990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-88f3b83e-b1e4-4c13-876a-cbd67e0de12b tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:17.174127 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-88f3b83e-b1e4-4c13-876a-cbd67e0de12b tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:17.437957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-88f3b83e-b1e4-4c13-876a-cbd67e0de12b tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:17.459821 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-88f3b83e-b1e4-4c13-876a-cbd67e0de12b tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1215 microversion: 2.1 time: 0.306443 Jul 28 02:18:17.461330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 8/14] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:17 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1215 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:17.467508 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-389105606", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7a41f53-02ba-4d68-a9f3-9f5c3103be75"}], "security_groups": [{"name": "tempest-securitygroup--1125193305"}], "key_name": "tempest-keypair-445458978", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:17.666143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] validate_networks() for [('b7a41f53-02ba-4d68-a9f3-9f5c3103be75', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:18:17.719461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-21950e54-3458-42ec-8bb6-77cd8029f1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: .version_select at 0x7efc58c00160>, body: {"keypair": {"name": "tempest-keypair-525184663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl6gh1/xy/nln7/ig1+FLGoPGcDbxOhYtfqy2XXl/FECQuFyzhvhLnD+5v3QMRH/QCX0Iblhx2rTV0pQUmLPZP7PfCxbi0+44jkriWHsgJfa2GKtSBt4+rlHAOxBeR2XA=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:17.906247 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-21950e54-3458-42ec-8bb6-77cd8029f1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:18:17.941837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-21950e54-3458-42ec-8bb6-77cd8029f1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:18:18.098145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-21950e54-3458-42ec-8bb6-77cd8029f1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.115082 Jul 28 02:18:18.099027 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 7/15] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:18:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:18.482676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b675dc7f-7943-4b03-9979-0fb8241b1bd8 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:18.483353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b675dc7f-7943-4b03-9979-0fb8241b1bd8 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:18.840038 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b675dc7f-7943-4b03-9979-0fb8241b1bd8 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:18.847947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:18:18.848612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:18:18.848815 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:18:18.849449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:18:18.850034 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:18:18.870687 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b675dc7f-7943-4b03-9979-0fb8241b1bd8 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1215 microversion: 2.1 time: 0.392526 Jul 28 02:18:18.871274 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:18 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:18.884862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:18.884862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:18.884862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:18.884862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:18.932014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for project 1ed45da3e0024fa597d03299abae9859. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:18:18.965482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for user 67ffe17468b04aa6ab148a976b5464b4 and project 1ed45da3e0024fa597d03299abae9859. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:18:19.027438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:18:19.037599 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:18:19.247867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dfa4eb22-54c6-40f2-bcd2-4c9e21e08ff2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.785164 Jul 28 02:18:19.248531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 9/17] 10.222.0.40 () {62 vars in 1188 bytes} [Thu Jul 28 02:18:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 02:18:19.267385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:19.269145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:19.892480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d98e3edf-b49c-4f87-ab36-3063e70e0aaa tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:19.893288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d98e3edf-b49c-4f87-ab36-3063e70e0aaa tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:19.999870 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:20.014053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:20.016969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:20.040242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e0a3e1a-6ab8-4517-adf4-34fe4ec0e79c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1280 microversion: 2.20 time: 0.766273 Jul 28 02:18:20.053306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 9/18] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:19 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1280 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:20.250430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d98e3edf-b49c-4f87-ab36-3063e70e0aaa tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:20.263844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d98e3edf-b49c-4f87-ab36-3063e70e0aaa tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1215 microversion: 2.1 time: 0.375126 Jul 28 02:18:20.279623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 10/19] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:19 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1215 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:21.068072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:21.073046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:21.288757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:21.290524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:21.306477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:21.307125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:21.309854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:21.310406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:21.380954 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:21.401574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:21.403294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:21.411003 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-abb848a9-e3ce-44b3-9696-7acfe367a64c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1280 microversion: 2.20 time: 0.344885 Jul 28 02:18:21.415258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 10/20] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:21 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:21.632345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:21.650741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6daf35aa-25fc-40a3-99a8-9547fd2f8ef5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1219 microversion: 2.1 time: 0.366946 Jul 28 02:18:21.652607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 11/21] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:21 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1219 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:22.440175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:22.440695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:22.458605 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:22.459078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:22.464219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:22.465455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:22.675789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:22.677511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:22.684686 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:22.685473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:22.686464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:22.687115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:22.783429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:22.796997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f06832c-6b14-4aa6-ad9b-539c276e7c76 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1219 microversion: 2.1 time: 0.127602 Jul 28 02:18:22.798118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 12/22] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:22 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:23.016843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:23.040777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:23.059303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:23.062034 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b2b15bb6-e970-415b-bb8e-3b7f67ec50e2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1284 microversion: 2.20 time: 0.626132 Jul 28 02:18:23.068307 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 11/23] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:22 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1284 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:23.070871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1253267001", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda255f1-8497-41f0-9d65-8f281bd7eb0d"}], "security_groups": [{"name": "tempest-securitygroup--1665482734"}], "key_name": "tempest-keypair-525184663", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:23.386369 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] validate_networks() for [('bda255f1-8497-41f0-9d65-8f281bd7eb0d', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:18:23.838763 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:23.847604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:23.864810 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:23.869181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:23.870312 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:23.870772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:24.810408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:24.822066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3637b834-a7a7-4cff-ab6b-aefe2f92b496 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1267 microversion: 2.1 time: 0.997424 Jul 28 02:18:24.845752 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 12/24] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:23 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1267 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:24.861520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:24.864146 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:24.876217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:24.882190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:24.884927 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:24.885549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:25.458333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:25.470234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:25.471732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:25.482620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-44e073e4-36f7-4fec-bab5-92f1cdf8cdc9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1338 microversion: 2.20 time: 0.623043 Jul 28 02:18:25.486685 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 13/25] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:24 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1338 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:25.714422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:18:25.714977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:18:25.715705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:18:25.715705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:18:25.716085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:18:25.740357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:25.743442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:25.744471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:25.744950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:25.787142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:18:25.794802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:18:25.832130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:18:25.845737 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:25.847240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:25.853046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:18:25.869510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:25.874149 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:25.874983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:25.875422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:25.977407 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-00c0949e-5a32-4e27-b4be-b1e85afe89fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.911242 Jul 28 02:18:25.978900 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 13/26] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:18:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:18:25.999186 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-45ae8904-35dd-4c77-9b27-cfb8d1522f44 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:26.000549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-45ae8904-35dd-4c77-9b27-cfb8d1522f44 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:27.594054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:27.611215 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-45ae8904-35dd-4c77-9b27-cfb8d1522f44 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:27.622986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-45ae8904-35dd-4c77-9b27-cfb8d1522f44 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1241 microversion: 2.1 time: 1.626880 Jul 28 02:18:27.625207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-247591ae-2384-4e69-8300-598b13a37cde tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1273 microversion: 2.1 time: 1.776325 Jul 28 02:18:27.630388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 14/27] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:25 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1273 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:27.640857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 14/28] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:25 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1241 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:27.647940 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:27.649063 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:27.676462 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:27.681474 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:27.683548 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:27.687567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:28.303043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:28.314070 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:28.340233 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:28.357847 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1b49fb46-9f08-4406-801d-ac8691c13d13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.725368 Jul 28 02:18:28.360540 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 15/29] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:27 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:28.653204 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:28.654159 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:28.668267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:28.669784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:28.675877 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:28.678487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:28.679059 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:28.679524 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:28.684249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:28.684631 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:28.685797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:28.686789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:28.926966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:28.951839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a666875b-f551-49d8-a04b-e60112475f5c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1237 microversion: 2.1 time: 0.305731 Jul 28 02:18:28.975641 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 15/30] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:28 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1237 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:29.287655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:29.323453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f655ef6b-08f5-4004-b1f7-ce05445e8f14 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.656632 Jul 28 02:18:29.324909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 16/31] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:28 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:29.396190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:29.397588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:29.413124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:29.414221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:29.416017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:29.416961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:29.867890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:29.887036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:29.890611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:29.893061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d97cd696-9a37-43bb-a318-5cf2ff0d1c37 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.506164 Jul 28 02:18:29.918957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 16/32] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:29 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:30.021261 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:30.030140 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:30.069229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.070307 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:30.077859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.079035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:30.324401 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:30.358619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:30.359258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:30.367499 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-afc125a6-f272-4453-beab-9e308360a1c5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1311 microversion: 2.1 time: 0.351904 Jul 28 02:18:30.371747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 17/33] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:30 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1311 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:30.375183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.375837 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:30.376631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.392273 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:30.928473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:30.930618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:30.976192 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.978611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:30.978611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:30.978611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:31.211715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:31.266065 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c317cdee-ee2f-4f74-b1d0-c047a6f02eba tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.911654 Jul 28 02:18:31.269603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 17/34] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:30 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:31.391738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:31.392396 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=10 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:31.394464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:31.397029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:31.430022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:31.430980 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:31.432090 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:31.434154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:31.856055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:31.879169 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4197e163-758f-4206-a9d8-25a6918d7471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1299 microversion: 2.1 time: 0.492578 Jul 28 02:18:31.880350 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 18/35] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:31 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1299 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:32.016946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:32.035011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:32.038910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:32.040845 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-522dbda9-ddfd-42c4-8041-0326cd34af32 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 1.119078 Jul 28 02:18:32.044617 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 18/36] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:30 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:32.291882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:32.292672 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:32.325660 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:32.327189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:32.332416 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:32.332416 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:32.927516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:32.929240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:32.952256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:32.954034 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:32.960934 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:32.961655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.046100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:33.074836 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-862780f0-ea8b-4b78-83b1-e911482eddc7 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.785243 Jul 28 02:18:33.093289 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 19/37] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:32 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:33.110469 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:33.114347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:33.156557 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:33.166958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.168361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:33.172262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.493553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:33.508566 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7b113a90-1137-4e87-898f-5d91d01178eb tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1299 microversion: 2.1 time: 0.585843 Jul 28 02:18:33.509277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:32 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1299 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:33.746305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e4ad4e26-fccb-4de1-a725-c5f037288439 req-5bfd505d-0b1b-42d0-8498-1820e2bc7f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00debb19-ca1a-4dc1-ab8a-08c6a04ed862", "tag": "1a626239-e398-4f6c-af9a-cb4483118c82"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:33.763417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e4ad4e26-fccb-4de1-a725-c5f037288439 req-5bfd505d-0b1b-42d0-8498-1820e2bc7f34 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:33.764333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e4ad4e26-fccb-4de1-a725-c5f037288439 req-5bfd505d-0b1b-42d0-8498-1820e2bc7f34 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.801723 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e4ad4e26-fccb-4de1-a725-c5f037288439 req-5bfd505d-0b1b-42d0-8498-1820e2bc7f34 service nova] Creating event network-changed:1a626239-e398-4f6c-af9a-cb4483118c82 for instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 on hv-cinder-79987 Jul 28 02:18:33.802050 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e4ad4e26-fccb-4de1-a725-c5f037288439 req-5bfd505d-0b1b-42d0-8498-1820e2bc7f34 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 02:18:33.803397 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:33.804077 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.804908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:33.805332 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:33.821139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.compute.rpcapi [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 02:18:33.822573 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] Releasing lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 02:18:33.871413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aacb166d-5214-4de1-a3ea-f577d99a403e None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303491 Jul 28 02:18:33.876577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 20/39] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:18:34.103525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:34.105309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:34.121156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.123609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.124844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.125332 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.243021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:34.253375 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:34.256176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:34.261050 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02aa5bb9-3185-4e6d-aa7e-58bf4108d9d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 1.161443 Jul 28 02:18:34.273197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 20/40] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:33 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:34.369534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:34.392266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a53d3593-2a45-4eba-8cc8-6d402a721f4f tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.293953 Jul 28 02:18:34.395089 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 21/41] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:34 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:34.414391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-cd23553a-8985-46b5-80d8-6bc7ab9951e3 req-226624d4-9882-447f-b963-353653b98fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:34.443312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cd23553a-8985-46b5-80d8-6bc7ab9951e3 req-226624d4-9882-447f-b963-353653b98fa5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.444765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cd23553a-8985-46b5-80d8-6bc7ab9951e3 req-226624d4-9882-447f-b963-353653b98fa5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.482772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-cd23553a-8985-46b5-80d8-6bc7ab9951e3 req-226624d4-9882-447f-b963-353653b98fa5 service nova] Creating event network-changed:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:18:34.483325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cd23553a-8985-46b5-80d8-6bc7ab9951e3 req-226624d4-9882-447f-b963-353653b98fa5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 02:18:34.491636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.492151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.493344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.493785 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.504163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.compute.rpcapi [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 02:18:34.505330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 02:18:34.525201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1c44bdf8-ee21-4719-8aad-6856a74413c6 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253647 Jul 28 02:18:34.526984 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 21/42] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:34.534051 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:34.535236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:34.549135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.550876 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.552130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:34.553113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:34.780486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:34.790043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9c9b832-500b-4ba9-a2bb-bd84f975753d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.262838 Jul 28 02:18:34.795140 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:34 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:35.289382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:35.291020 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:35.298505 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.298966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:35.299784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.300425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:35.417867 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:35.419520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:35.426951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.427410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:35.428193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.428802 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:35.528487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:35.540593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:35.550647 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:35.558580 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a991c237-b3b5-480e-8916-1f14d248bd7d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.275234 Jul 28 02:18:35.569433 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 22/44] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:35 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:35.691447 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:35.713995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6717ec17-0997-4db9-b368-cc99f0704859 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.300004 Jul 28 02:18:35.718227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 23/45] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:35 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:35.815981 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:35.817315 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:35.826933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.827607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:35.828822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:35.829512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:36.058327 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:36.076301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7aaedf17-f1df-4dd1-92ed-9d267c711c0d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.267008 Jul 28 02:18:36.083916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 23/46] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:35 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:36.603450 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:36.604285 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:36.617451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:36.618017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:36.619160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:36.620900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:36.736301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:36.737240 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:36.747592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:36.748831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:36.749990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:36.750622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:36.963522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:36.989843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:36.993586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:36.996160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-febd980f-5707-4bd3-ab5b-ff7a99206c87 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.398204 Jul 28 02:18:36.997495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 24/47] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:36 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:37.061980 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:37.077668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-01d467e1-9040-4b22-9824-5ce63380eed2 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.345508 Jul 28 02:18:37.078758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 24/48] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:36 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:37.101915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:37.102547 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:37.115771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:37.116909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:37.134642 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:37.135395 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:37.489676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:37.504593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cb7c3889-bc84-4e85-b25c-4868a90aad34 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.408408 Jul 28 02:18:37.505599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 25/49] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:37 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:38.031487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:38.037940 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:38.059937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=28 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:38.063701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.067992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.069812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.070839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.116983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:38.117636 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:38.132938 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.133746 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.135140 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.135959 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.414081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:38.418493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:38.425831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:38.428064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:38.429914 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-98b852c9-9a99-48f3-a4ed-3684aa229159 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.407945 Jul 28 02:18:38.431077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 25/50] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:38 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:38.436746 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c220754-8cd0-457f-92ae-fe5940e6c6a3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.339103 Jul 28 02:18:38.438217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 26/51] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:38 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:38.540537 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:38.543428 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:38.551825 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.552605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.553616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:38.554055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:38.759162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:38.767235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bddfe037-54fc-4837-8379-03727e0db417 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.230922 Jul 28 02:18:38.769711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 26/52] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:38 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:39.460833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:39.461459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:39.461459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:39.463244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:39.467720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.468166 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.469158 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.469747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.470553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.471187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.473378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.473946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.763211 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:39.767122 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:39.776596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:39.779067 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:39.781247 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:39.782993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-faa1cfe6-4968-4740-96e0-bb099ffec1ec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.327072 Jul 28 02:18:39.792434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc1b65d2-0bc9-4d40-9115-b144c76fcea9 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.335660 Jul 28 02:18:39.796943 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 27/53] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:39 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:39.804440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 27/54] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:39 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:39.811621 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:39.813200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:39.823909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.824399 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.825518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:39.826954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:39.982300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:39.985932 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:39.992406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-885fc258-7b37-41ec-a4af-93edf9d59c7b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.197325 Jul 28 02:18:40.005528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 28/55] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:39 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:40.811538 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:40.812277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:40.817780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:40.819023 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:40.819769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:40.820221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:40.821020 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:40.822084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:40.826430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:40.827092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:40.828032 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:40.828600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:41.034023 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:41.038700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:41.043993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:41.045837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:41.046092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d90261f-4869-498e-94e3-70efe6582583 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.234209 Jul 28 02:18:41.046846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 29/56] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:40 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:18:41.047000 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a30d6b23-4db6-4fae-a54d-ffd87bcc816f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.239661 Jul 28 02:18:41.047888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 28/57] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:40 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:41.059740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:41.060621 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:41.067623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:41.068075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:41.068847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:41.069315 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:41.226601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:41.234190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37ce8ac1-35b4-49ed-a29d-e5795871cd57 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.186205 Jul 28 02:18:41.234863 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 30/58] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:41 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:42.071755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:42.075817 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:42.076455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:42.078299 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:42.091297 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.091751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.092572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.093785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.094652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.095815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.096743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.097317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.412851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:42.415097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:42.421023 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:42.424766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:42.425221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fe19f123-3697-4ff4-ae4e-3b571f9187ac tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.360871 Jul 28 02:18:42.425801 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:42 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:42.425974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b778f047-0958-4f29-aed6-931ee983431b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.358609 Jul 28 02:18:42.430919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:42.431732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:42.439704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.441010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.441478 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 31/60] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:42 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:42.442599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:42.443201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:42.618381 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:42.627063 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c80595ac-9806-484b-81ee-53baca45c34d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.200215 Jul 28 02:18:42.628507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 30/61] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:42 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:43.329006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ee2e11c3-5613-4732-a802-d819ebd3776a req-85c5dc05-49bc-403a-9f6e-a9bbb76aa0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d26f3b8-4d46-47fe-84fe-f242e97a778c", "tag": "f6815afe-e104-4782-8f6b-4017625ff4b9"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:43.343145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ee2e11c3-5613-4732-a802-d819ebd3776a req-85c5dc05-49bc-403a-9f6e-a9bbb76aa0f4 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.343977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ee2e11c3-5613-4732-a802-d819ebd3776a req-85c5dc05-49bc-403a-9f6e-a9bbb76aa0f4 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.360511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ee2e11c3-5613-4732-a802-d819ebd3776a req-85c5dc05-49bc-403a-9f6e-a9bbb76aa0f4 service nova] Creating event network-changed:f6815afe-e104-4782-8f6b-4017625ff4b9 for instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c on hv-cinder-79987 Jul 28 02:18:43.368890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ee2e11c3-5613-4732-a802-d819ebd3776a req-85c5dc05-49bc-403a-9f6e-a9bbb76aa0f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043667 Jul 28 02:18:43.370225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 32/62] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:43.449230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:43.451159 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:43.461008 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.461905 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.463086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.463764 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.466831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:43.467604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:43.480995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.490254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.491520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.492216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.774299 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:43.794611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-09327aae-6995-4f02-83c7-8650bbb67660 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.351024 Jul 28 02:18:43.797229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 31/63] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:43 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:43.809172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:43.809975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:43.817686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:43.820048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.820606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.820789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:43.822276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:43.822886 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:43.829294 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:43.831802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:43.833222 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee55109b-3313-40a1-b752-bd5bff290cbd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.371597 Jul 28 02:18:43.834026 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:43 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:44.010725 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:44.022429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d540663f-d679-4363-b5d4-b0783397deb8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.223424 Jul 28 02:18:44.036152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 32/65] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:43 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:44.819133 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:44.820348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:44.826513 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:44.829458 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:44.830111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:44.832036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:44.832743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:44.858465 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:44.859717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:44.867720 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:44.868172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:44.868994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:44.869492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:45.303411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:45.315820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62981250-9674-4bad-b19a-74d504fdc3ed tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.499980 Jul 28 02:18:45.317244 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:44 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:45.328415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:45.338174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:45.339668 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:45.351633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:45.351837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:45.352553 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:45.362317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:45.363331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:45.363818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:45.365372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-93ab3486-4ee6-45bb-a410-3ffcca8d7463 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.510807 Jul 28 02:18:45.365745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:44 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:45.715074 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:45.723859 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b4660eb6-e8be-4434-8547-bda608d1799d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.401262 Jul 28 02:18:45.724999 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 35/68] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:45 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:46.342551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:46.343627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:46.354027 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:46.354739 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:46.364279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:46.365231 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:46.396767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:46.398099 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:46.407577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:46.408047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:46.409482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:46.410128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:46.946429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:46.957689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:46.971785 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:46.972118 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d4d6e9bf-34e5-4e75-8dc8-934f60ff4bbd tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.631015 Jul 28 02:18:46.972797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 34/69] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:46 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:46.975070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:46.976238 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-feb1b681-0769-48d4-bb33-d7ff899ee5e8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.584294 Jul 28 02:18:46.979123 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:46 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:47.001667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:47.008320 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:47.013553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:47.038637 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:47.039131 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:47.040405 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:47.042123 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:47.254113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:47.267628 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-52d061d8-48db-475a-9cf7-62262a4e38b8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.292616 Jul 28 02:18:47.269688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:46 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:47.998974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:47.998974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:48.006135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:48.007308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:48.017924 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.021081 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.021983 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.024022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.025099 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.025712 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.026416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.027016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.624393 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:48.639837 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a2e17703-4439-4505-8dc1-fddf71d50b95 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.648718 Jul 28 02:18:48.640818 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:47 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:48.663493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:48.664622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:48.680163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.683996 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.685214 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:48.685819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:48.712342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:48.721881 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:48.728713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:48.730647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d57ab1d1-3c39-4200-9eb5-18b043d74b46 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.730441 Jul 28 02:18:48.731587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 36/73] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:47 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:48.947570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:48.958575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-45bd4a70-2e53-4fea-a1bd-cb1d9f251189 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.316356 Jul 28 02:18:48.963179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 38/74] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:48 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:49.673769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:49.675709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:49.686597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:49.689009 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:49.693566 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:49.694451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:49.757580 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:49.758160 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:49.774242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:49.775064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:49.778073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:49.780909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:50.028110 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:50.039846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c2c751f0-dca1-4daf-a96b-fba69e6285fb tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.376273 Jul 28 02:18:50.041184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 37/75] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:49 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:50.045967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:50.046781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:50.053562 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:50.056898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:50.057156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:50.058759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:50.059248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:50.066735 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:50.068639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:50.069957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-308c0003-d28f-497a-9879-bdf4e3816001 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.318977 Jul 28 02:18:50.086269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:49 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:50.307039 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:50.318555 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc56a0d5-bf21-4912-a03a-fd6abf25beb9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.275981 Jul 28 02:18:50.320012 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 38/77] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:50 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:51.065297 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:51.067123 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:51.075228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.076191 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.077358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.078477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.099001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:51.099923 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:51.116615 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.119426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.124062 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.125520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.396413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:51.409889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-31b1e0bd-62da-440c-b6d5-3bbd309fd188 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.346054 Jul 28 02:18:51.432038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 40/78] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:51 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:51.456125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:51.457215 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:51.457669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:51.464502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.465440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.466670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:51.467326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:51.469873 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:51.478007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:51.485023 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7d05d9f2-9bcc-425d-87f0-6376852f1ec3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.392071 Jul 28 02:18:51.488140 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 39/79] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:51 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:51.774833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:51.785229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-73bb9521-1fbd-4130-9809-89eaa27dd99f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.351864 Jul 28 02:18:51.785875 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 41/80] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:51 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:52.443753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:52.445575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:52.461849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.463804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:52.467125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.481798 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:52.519747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:52.520915 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:52.536165 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.537974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:52.541771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.542697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:52.784491 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:52.803502 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-183f3d7f-7553-4206-a410-9cf7b4d29185 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.369105 Jul 28 02:18:52.804202 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 40/81] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:52 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:52.833806 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:52.848913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:52.855038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:52.855038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1b6bde53-04f4-4cb9-b3a8-d46876a33522 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.339340 Jul 28 02:18:52.855038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 42/82] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:52 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:18:52.866728 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:52.867353 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:52.887385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.888091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:52.889284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:52.889913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:53.143609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:53.162221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f3750495-1f2b-4d9c-87de-8d49ed98353f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.308874 Jul 28 02:18:53.162820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 43/83] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:52 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:53.185660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-fbd6dc4f-b0d4-4ada-9f4c-39212d8aa246 req-9eea1634-0964-427c-bb54-bdb50b880886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00debb19-ca1a-4dc1-ab8a-08c6a04ed862", "name": "network-vif-plugged", "status": "completed", "tag": "1a626239-e398-4f6c-af9a-cb4483118c82"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:53.197238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fbd6dc4f-b0d4-4ada-9f4c-39212d8aa246 req-9eea1634-0964-427c-bb54-bdb50b880886 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:53.197873 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fbd6dc4f-b0d4-4ada-9f4c-39212d8aa246 req-9eea1634-0964-427c-bb54-bdb50b880886 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:53.215086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-fbd6dc4f-b0d4-4ada-9f4c-39212d8aa246 req-9eea1634-0964-427c-bb54-bdb50b880886 service nova] Creating event network-vif-plugged:1a626239-e398-4f6c-af9a-cb4483118c82 for instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 on hv-cinder-79987 Jul 28 02:18:53.221292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-fbd6dc4f-b0d4-4ada-9f4c-39212d8aa246 req-9eea1634-0964-427c-bb54-bdb50b880886 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415009 Jul 28 02:18:53.222660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 41/84] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:53.840359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:53.841942 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:53.851279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:53.852100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:53.853141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:53.856689 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:53.879935 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:53.880837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:53.904042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:53.906375 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:53.911453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:53.912414 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:54.241769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:54.254123 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:54.256167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:54.259591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eadd886b-ec74-4071-b794-2bf7be4128de tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.386853 Jul 28 02:18:54.272854 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 42/85] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:53 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:54.293630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:54.294459 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:54.295122 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:54.302574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:54.303252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:54.304365 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:54.305193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:54.314141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c5db50a7-73a1-45b6-a4c7-e56939ad12e5 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.478838 Jul 28 02:18:54.317725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 44/86] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:53 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:54.596696 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:54.612579 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c013f4bb-a293-4c2b-b186-bbc37dc40983 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.337567 Jul 28 02:18:54.637302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 43/87] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:54 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:55.257166 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-100039e5-10e5-4ce8-b226-31c89c43968d req-07345fb6-0442-4d17-aeb3-05ca6f69e6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "name": "network-vif-plugged", "status": "completed", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:55.284694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-100039e5-10e5-4ce8-b226-31c89c43968d req-07345fb6-0442-4d17-aeb3-05ca6f69e6db service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.285378 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-100039e5-10e5-4ce8-b226-31c89c43968d req-07345fb6-0442-4d17-aeb3-05ca6f69e6db service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.292220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:55.293181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:55.304587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-100039e5-10e5-4ce8-b226-31c89c43968d req-07345fb6-0442-4d17-aeb3-05ca6f69e6db service nova] Creating event network-vif-plugged:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:18:55.317125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.318298 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-100039e5-10e5-4ce8-b226-31c89c43968d req-07345fb6-0442-4d17-aeb3-05ca6f69e6db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078866 Jul 28 02:18:55.319427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.321299 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 45/88] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:55.322196 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.324405 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.344776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:55.347467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:55.366181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.367124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.368761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.372134 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.921195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:55.931092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:55.936443 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:55.937957 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:55.940515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:55.942518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-052f38ca-6efa-459e-87c3-174157618a33 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.660095 Jul 28 02:18:55.947048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60d65ccd-8243-45a0-8b07-77f9676bb228 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.609878 Jul 28 02:18:55.953540 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 44/89] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:55 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:55.961150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 46/90] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:55 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:55.976172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:55.976900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:55.983771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.984359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.985262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:55.985771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:55.991784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:18:56.157575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:56.168680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ae0d7882-fade-4e2d-9b1c-d928a3c8e6ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.206806 Jul 28 02:18:56.169486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 45/91] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:55 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:56.978802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:56.979592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:56.982076 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:56.983054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:56.998734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.000428 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.001364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.004274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.007177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.007652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.009956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.010811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.424717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:57.451619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:57.475272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:57.476823 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-42ec7a10-6e45-4477-b5b7-ad8462f40790 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1406 microversion: 2.20 time: 0.503656 Jul 28 02:18:57.479593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 46/92] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:56 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:57.489943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:57.491289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:57.499508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.500816 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.502898 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.503669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.681564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:57.711176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0598dfbb-06d4-4280-b54d-87475ce61303 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1315 microversion: 2.1 time: 0.746021 Jul 28 02:18:57.711766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 47/93] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:56 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:57.719927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-952db306-97b9-482b-bd70-9b86d47023f7 req-71ebd161-5d47-431a-811d-8016ed2fa7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d26f3b8-4d46-47fe-84fe-f242e97a778c", "name": "network-vif-plugged", "status": "completed", "tag": "f6815afe-e104-4782-8f6b-4017625ff4b9"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:18:57.768671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-952db306-97b9-482b-bd70-9b86d47023f7 req-71ebd161-5d47-431a-811d-8016ed2fa7aa service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:57.769359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-952db306-97b9-482b-bd70-9b86d47023f7 req-71ebd161-5d47-431a-811d-8016ed2fa7aa service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:57.815973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-952db306-97b9-482b-bd70-9b86d47023f7 req-71ebd161-5d47-431a-811d-8016ed2fa7aa service nova] Creating event network-vif-plugged:f6815afe-e104-4782-8f6b-4017625ff4b9 for instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c on hv-cinder-79987 Jul 28 02:18:57.828457 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-952db306-97b9-482b-bd70-9b86d47023f7 req-71ebd161-5d47-431a-811d-8016ed2fa7aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111595 Jul 28 02:18:57.831018 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 48/94] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:18:57.841345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:57.854667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fac0f43e-a9df-49e0-967d-beb47a91e861 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.373763 Jul 28 02:18:57.867029 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 47/95] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:57 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:58.528337 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:58.529268 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:58.537320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.538065 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:58.538865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.539628 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:58.732585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:58.733380 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:58.744209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.745121 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:58.746147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.749879 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:58.761558 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:58.773881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:58.775855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:58.777480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-08ae96d0-118b-4191-a03f-d4d0db24e2d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1598 microversion: 2.20 time: 0.254770 Jul 28 02:18:58.790434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 49/96] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:18:58 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1598 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:18:58.813494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:58.814183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:58.823028 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.823989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:58.825653 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:58.826258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:59.069294 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7708f7e8-a4c5-4b77-a48e-60cfa5220bb9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.265733 Jul 28 02:18:59.070655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 50/97] 10.222.0.40 () {60 vars in 1316 bytes} [Thu Jul 28 02:18:58 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-interface => generated 285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:18:59.089269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:18:59.091010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:18:59.125226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:59.131713 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:59.141272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5b3be05c-55f1-4fdb-8446-70c08027c884 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1502 microversion: 2.1 time: 0.412605 Jul 28 02:18:59.143041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 48/98] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:58 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1502 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:18:59.145625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:59.147552 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:18:59.149097 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:18:59.646705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:18:59.665301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1df5f4c0-9942-411d-b0e5-833cbe0fe427 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1367 microversion: 2.1 time: 0.589513 Jul 28 02:18:59.665947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 51/99] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:18:59 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:00.696072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:00.696702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:00.719087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:00.719220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:00.720195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:00.720644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:01.251029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de957508-29eb-4616-9a53-f9262f90f292"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:01.257036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:01.276161 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:01.277197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:01.278257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:01.278878 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:01.532381 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:01.555175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd878267-81e3-4c5a-9d3a-393c3c0ce449 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1558 microversion: 2.1 time: 0.863439 Jul 28 02:19:01.556659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 49/100] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:00 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1558 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:01.585475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:01.586458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:01.603896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:01.604708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:01.605743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:01.607528 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:02.050867 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2483c5b-081f-4ce1-af7b-df3cd87d7afe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.471106 Jul 28 02:19:02.051878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 50/101] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:19:01 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-interface => generated 285 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:19:02.300704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0de97d1f-a1fa-4693-bdd0-d5a33b858975 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "POST /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056029 Jul 28 02:19:02.327948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 52/102] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:19:01 2022] POST /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:19:02.375571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-097e1dce-379d-4737-b04b-22697c78abbb req-db526382-b0e8-441e-ad0e-0e02f3f51e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:02.416958 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-097e1dce-379d-4737-b04b-22697c78abbb req-db526382-b0e8-441e-ad0e-0e02f3f51e8c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:02.422739 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-097e1dce-379d-4737-b04b-22697c78abbb req-db526382-b0e8-441e-ad0e-0e02f3f51e8c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:02.464122 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-097e1dce-379d-4737-b04b-22697c78abbb req-db526382-b0e8-441e-ad0e-0e02f3f51e8c service nova] Creating event network-changed:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:19:02.478254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-097e1dce-379d-4737-b04b-22697c78abbb req-db526382-b0e8-441e-ad0e-0e02f3f51e8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107023 Jul 28 02:19:02.478862 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 51/103] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:19:05.299497 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-53146eef-4324-4162-a469-250e4237ce07 req-8219c917-e8f8-4939-b2c4-973222ab209e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d26f3b8-4d46-47fe-84fe-f242e97a778c", "tag": "f6815afe-e104-4782-8f6b-4017625ff4b9"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:05.305332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=70 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:05.336336 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-53146eef-4324-4162-a469-250e4237ce07 req-8219c917-e8f8-4939-b2c4-973222ab209e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:05.338126 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-53146eef-4324-4162-a469-250e4237ce07 req-8219c917-e8f8-4939-b2c4-973222ab209e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:05.361847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-53146eef-4324-4162-a469-250e4237ce07 req-8219c917-e8f8-4939-b2c4-973222ab209e service nova] Creating event network-changed:f6815afe-e104-4782-8f6b-4017625ff4b9 for instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c on hv-cinder-79987 Jul 28 02:19:05.369977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-53146eef-4324-4162-a469-250e4237ce07 req-8219c917-e8f8-4939-b2c4-973222ab209e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075104 Jul 28 02:19:05.371034 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 53/104] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:10.760487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:10.762121 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:10.775066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:10.776162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:10.777760 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:10.778343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:10.815200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:19:11.023117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2dc04f59-8e5a-4d56-8a12-090a99c4dabc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "DELETE /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 204 len: 0 microversion: 2.1 time: 0.276361 Jul 28 02:19:11.024928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 52/105] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:19:10 2022] DELETE /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:19:11.036106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:11.037772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:11.052052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:11.057554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:11.058578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:11.059255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:11.309725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:11.320129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4719692d-0295-49e6-a370-36c7d55357cc tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1554 microversion: 2.1 time: 0.290288 Jul 28 02:19:11.320712 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 54/106] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:11 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:12.342475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:12.343465 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:12.351935 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:12.352718 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:12.354064 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:12.354591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:12.547007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:12.558059 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-509a1816-0d8a-47b5-824f-3ed37448a548 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1554 microversion: 2.1 time: 0.219667 Jul 28 02:19:12.559068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 53/107] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:12 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:13.584281 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:13.584936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:13.603658 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:13.605560 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:13.608657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:13.612905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:13.744703 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:13.753599 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-84992ec9-71fb-4b54-ab0a-567b1080cf99 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1512 microversion: 2.1 time: 0.176118 Jul 28 02:19:13.754212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 55/108] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:13 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:13.918686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e0cd26a0-a0c4-4a70-95f8-81f184bcc940 req-fc04bf18-debe-4d0f-8707-b7cdab696ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00debb19-ca1a-4dc1-ab8a-08c6a04ed862", "name": "network-vif-deleted", "tag": "1a626239-e398-4f6c-af9a-cb4483118c82"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:13.938829 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e0cd26a0-a0c4-4a70-95f8-81f184bcc940 req-fc04bf18-debe-4d0f-8707-b7cdab696ed5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:13.941268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e0cd26a0-a0c4-4a70-95f8-81f184bcc940 req-fc04bf18-debe-4d0f-8707-b7cdab696ed5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:13.961791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e0cd26a0-a0c4-4a70-95f8-81f184bcc940 req-fc04bf18-debe-4d0f-8707-b7cdab696ed5 service nova] Creating event network-vif-deleted:1a626239-e398-4f6c-af9a-cb4483118c82 for instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 on hv-cinder-79987 Jul 28 02:19:13.969252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e0cd26a0-a0c4-4a70-95f8-81f184bcc940 req-fc04bf18-debe-4d0f-8707-b7cdab696ed5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054730 Jul 28 02:19:13.971373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 54/109] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:14.780130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:14.784017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:14.811045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:14.812448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:14.816079 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:14.819237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:14.892221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:14.899701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:14.900430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lazy-loading 'fault' on Instance uuid 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:19:15.021927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11107befbd514c76844b15204ca45413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a042e3701d7842b29f4f3caddc8dd0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:15.037057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-01c60560-280c-4de4-8f02-fd8cde163c30 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 200 len: 1351 microversion: 2.1 time: 0.262697 Jul 28 02:19:15.037733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 56/110] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:14 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:16.063585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:16.065458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:16.073688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:16.074389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:16.074931 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:16.075531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:16.094782 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] HTTP exception thrown: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Request method failure captured: Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 HTTP/1.1 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHmDxmLMjMokXSFlAeguxSiGM9Wvzg3fRJugs5RHqZfTCLBIBaJDI-abuVNUAUkJF7i9W-2Cma3e21G8UM_RxtT9vGSVTdSALAO3ckYeGQ5TjGIC92y0m2wUQNOotv1B00jDMLisUdA3MczmjY9Z5Dc0IjJbJFzx_Micm6gwibKykA Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:19:16.101627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 11107befbd514c76844b15204ca45413 Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.102791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '00debb19-ca1a-4dc1-ab8a-08c6a04ed862'} Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:19:16.103714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.104735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.106239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Returning 404 to user: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:19:16.106239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3dd6d644-f698-46bc-9f86-516bfa60b485 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 404 len: 111 microversion: 2.1 time: 0.044968 Jul 28 02:19:16.109043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 55/111] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:16 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:19:16.445276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:16.450047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:16.460479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:16.461470 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:16.462245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:16.462850 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] HTTP exception thrown: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Request method failure captured: Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862/os-volume_attachments HTTP/1.1 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHmDxmLMjMokXSFlAeguxSiGM9Wvzg3fRJugs5RHqZfTCLBIBaJDI-abuVNUAUkJF7i9W-2Cma3e21G8UM_RxtT9vGSVTdSALAO3ckYeGQ5TjGIC92y0m2wUQNOotv1B00jDMLisUdA3MczmjY9Z5Dc0IjJbJFzx_Micm6gwibKykA Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:19:16.489579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 11107befbd514c76844b15204ca45413 Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.490857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'server_id': '00debb19-ca1a-4dc1-ab8a-08c6a04ed862'} Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:19:16.491501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:16.492523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:16.498288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Returning 404 to user: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:19:16.498288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ac2e08aa-d22c-49ce-83bf-b0426532d822 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052135 Jul 28 02:19:16.498288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 57/112] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:19:16 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:19:17.899654 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:17.899654 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:17.900167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:17.908678 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:17.909803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:17.910105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:17.910607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:17.930450 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] HTTP exception thrown: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Request method failure captured: Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 HTTP/1.1 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHmDxmLMjMokXSFlAeguxSiGM9Wvzg3fRJugs5RHqZfTCLBIBaJDI-abuVNUAUkJF7i9W-2Cma3e21G8UM_RxtT9vGSVTdSALAO3ckYeGQ5TjGIC92y0m2wUQNOotv1B00jDMLisUdA3MczmjY9Z5Dc0IjJbJFzx_Micm6gwibKykA Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:19:17.931995 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 11107befbd514c76844b15204ca45413 Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.933442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '00debb19-ca1a-4dc1-ab8a-08c6a04ed862'} Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:19:17.934220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.936060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.938972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Returning 404 to user: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:19:17.938972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2a525b9-d027-459a-beef-1b4b5d3d7eb3 tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "DELETE /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 404 len: 111 microversion: 2.1 time: 0.040579 Jul 28 02:19:17.938972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 56/113] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:19:17 2022] DELETE /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:19:17.945607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:17.947098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] [instance: 00debb19-ca1a-4dc1-ab8a-08c6a04ed862] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:17.957810 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:17.958263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:17.959039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:17.959474 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:17.974253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] HTTP exception thrown: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Request method failure captured: Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 HTTP/1.1 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHmDxmLMjMokXSFlAeguxSiGM9Wvzg3fRJugs5RHqZfTCLBIBaJDI-abuVNUAUkJF7i9W-2Cma3e21G8UM_RxtT9vGSVTdSALAO3ckYeGQ5TjGIC92y0m2wUQNOotv1B00jDMLisUdA3MczmjY9Z5Dc0IjJbJFzx_Micm6gwibKykA Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:19:17.976930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a042e3701d7842b29f4f3caddc8dd0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: a042e3701d7842b29f4f3caddc8dd0b8 Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-941814662 Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 11107befbd514c76844b15204ca45413 Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-941814662-project Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.978822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '00debb19-ca1a-4dc1-ab8a-08c6a04ed862'} Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:19:17.979778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. Jul 28 02:19:17.981333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:19:17.982410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] Returning 404 to user: Instance 00debb19-ca1a-4dc1-ab8a-08c6a04ed862 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:19:17.982410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-664234af-43a8-499a-976a-bbdf76826a0c tempest-DeleteServersTestJSON-941814662 tempest-DeleteServersTestJSON-941814662-project] 10.222.0.40 "GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862" status: 404 len: 111 microversion: 2.1 time: 0.040941 Jul 28 02:19:17.982410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 58/114] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:17 2022] GET /compute/v2.1/servers/00debb19-ca1a-4dc1-ab8a-08c6a04ed862 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:19:36.888571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:36.889788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:37.129650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1263423473", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:37.265147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] validate_networks() for [('409dbfc5-7fa3-448b-9a8d-151bbb9f6be9', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:19:37.370839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:37.371449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:37.380922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=13 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:37.382645 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:37.387872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:37.394475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:37.398146 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:37.399900 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:37.495437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6eb1fa2e-5ac9-4b0d-bdcc-59dfd9bbb01f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/ips" status: 200 len: 152 microversion: 2.20 time: 0.132832 Jul 28 02:19:37.496489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 59/115] 10.222.0.40 () {60 vars in 1289 bytes} [Thu Jul 28 02:19:37 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/ips => generated 152 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:19:38.769686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:19:38.770249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:19:38.770561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:19:38.770969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:19:38.771376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:19:38.783630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:38.784645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:38.790561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:38.793593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:38.852705 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:19:38.871320 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for user 50a2f75083ec40f3a6254c25b57862ae and project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:19:38.914745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:19:38.917735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:19:39.105315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-74b0c421-a199-40f5-b36e-72897cd0f0ee tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.221358 Jul 28 02:19:39.106090 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 57/116] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:19:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:19:39.119396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3fcddfc5-37e4-43fd-a1ae-d04f40d0e68c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:39.120025 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3fcddfc5-37e4-43fd-a1ae-d04f40d0e68c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:39.278601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3fcddfc5-37e4-43fd-a1ae-d04f40d0e68c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:39.290430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3fcddfc5-37e4-43fd-a1ae-d04f40d0e68c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1222 microversion: 2.1 time: 0.176164 Jul 28 02:19:39.307612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 60/117] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:39 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:39.504024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2055567746", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:39.632021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] validate_networks() for [('409dbfc5-7fa3-448b-9a8d-151bbb9f6be9', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:19:40.249615 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:40.250114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:40.288605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:40.290274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:40.292916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:40.293669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:40.426242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4dbd2773-1fe5-40ff-80f8-10dab236527b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/ips" status: 200 len: 150 microversion: 2.1 time: 0.182760 Jul 28 02:19:40.447262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 61/118] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:19:40 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/ips => generated 150 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:19:40.698764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:40.699315 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:40.714571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:40.723844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:40.725180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:40.727452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:40.855679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lazy-loading 'flavor' on Instance uuid 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:19:41.030204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:19:41.030719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:19:41.031393 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:19:41.032094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:19:41.033306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:19:41.065569 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:41.067492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:41.072694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:41.075656 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:41.159189 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:19:41.167541 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for user 50a2f75083ec40f3a6254c25b57862ae and project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:19:41.198797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:19:41.208496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:19:41.330092 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4c5dc5ca-4585-434a-a1c1-ced6c5c4d9d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.832778 Jul 28 02:19:41.333279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 58/119] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:19:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:19:41.349736 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2d3bdf09-83c2-42dc-b6a8-c98205c0c345 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:41.350696 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2d3bdf09-83c2-42dc-b6a8-c98205c0c345 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:41.537977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2d3bdf09-83c2-42dc-b6a8-c98205c0c345 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:41.556778 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2d3bdf09-83c2-42dc-b6a8-c98205c0c345 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1222 microversion: 2.1 time: 0.207685 Jul 28 02:19:41.557993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 59/120] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:41 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:41.748834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-192447c6-9676-402e-bd17-86ff0caa67d7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/action" status: 202 len: 0 microversion: 2.20 time: 1.052284 Jul 28 02:19:41.752199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 62/121] 10.222.0.40 () {62 vars in 1319 bytes} [Thu Jul 28 02:19:40 2022] POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/action => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 02:19:41.761675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:41.762410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:41.793789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:41.793789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:41.793789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:41.794084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:42.137438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:42.151577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:42.155223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:42.156590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-919a6c82-f722-492b-89b1-ebdf2d90ce86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.399335 Jul 28 02:19:42.157207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 60/122] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:41 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:19:42.583623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:42.584367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:42.603761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:42.604223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:42.605142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:42.605572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:42.748450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:42.759555 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf2d2c3b-7156-4219-84a8-19f711124324 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1226 microversion: 2.1 time: 0.183172 Jul 28 02:19:42.761929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 63/123] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:42 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1226 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:42.789485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5841f91a-ce79-43a5-97b6-ff41314425a0"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:42.793787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:42.812726 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:42.814368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:42.815410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:42.816915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:43.187569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:43.188818 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:43.202539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:43.203000 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:43.203797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:43.204228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:43.587475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:43.597112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:43.598664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:43.600071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a4731c61-ac85-4591-a783-e7333ab16a23 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.416469 Jul 28 02:19:43.636908 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 64/124] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:43 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:43.775933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5b0a823b-6d50-4a1e-a5ac-d688d7532fbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991400 Jul 28 02:19:43.776657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 61/125] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:19:42 2022] POST /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:43.785678 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:43.786278 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:43.801418 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:43.801872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:43.802677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:43.803216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:44.236661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:44.260651 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c3a4ee24-afd2-4c42-ade7-0c84ac802fd7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1292 microversion: 2.1 time: 0.478576 Jul 28 02:19:44.266443 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 65/126] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:43 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1292 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:44.673182 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:44.676193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:44.734775 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:44.742404 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:44.749557 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:44.765055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:45.297183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:45.298970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:45.311035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:45.313613 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:45.315588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:45.316303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:45.416430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:45.439561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:45.444262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:45.445934 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a4f85b0-b7de-42f8-a511-5a412c3cb1e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.788403 Jul 28 02:19:45.447081 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 62/127] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:44 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:45.513520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:45.536304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f297ddf1-789e-4964-96f6-db2a5fa6bd43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1280 microversion: 2.1 time: 0.247975 Jul 28 02:19:45.536985 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 66/128] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:45 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:46.475321 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:46.476755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:46.490308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:46.491970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:46.496330 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:46.497197 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:46.565297 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:46.566335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:46.604847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:46.605458 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:46.606263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:46.606701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:47.147596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:47.169895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:47.190213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:47.191453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-548f4c40-8e4f-446e-912e-1f2622a6329a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.720575 Jul 28 02:19:47.193283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 63/129] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:46 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:47.335198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:47.355202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2fe55738-32fc-44a2-af3c-6b657b7ed4a7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.792759 Jul 28 02:19:47.356217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 67/130] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:46 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:48.220539 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:48.221729 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:48.238949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:48.240609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:48.242567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:48.243171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:48.330826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e253f2ee-99f7-4e9c-9536-b417be83fb3d req-7887fb99-dd76-4663-834b-e88e8033bb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57fb7f5a-d860-4022-a284-a364155ba3ba", "tag": "40d8500a-f1bf-4d76-ab1d-ab85d099d88f"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:48.354982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e253f2ee-99f7-4e9c-9536-b417be83fb3d req-7887fb99-dd76-4663-834b-e88e8033bb66 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:48.355828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e253f2ee-99f7-4e9c-9536-b417be83fb3d req-7887fb99-dd76-4663-834b-e88e8033bb66 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:48.373332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e253f2ee-99f7-4e9c-9536-b417be83fb3d req-7887fb99-dd76-4663-834b-e88e8033bb66 service nova] Creating event network-changed:40d8500a-f1bf-4d76-ab1d-ab85d099d88f for instance 57fb7f5a-d860-4022-a284-a364155ba3ba on hv-cinder-79987 Jul 28 02:19:48.385200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e253f2ee-99f7-4e9c-9536-b417be83fb3d req-7887fb99-dd76-4663-834b-e88e8033bb66 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064004 Jul 28 02:19:48.386576 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 68/131] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:48.394523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:48.399077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:48.419574 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:48.421181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:48.424072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:48.424733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:49.092988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:49.124444 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8a12a11e-da7a-45e8-9040-3bf60e2e7498 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.736225 Jul 28 02:19:49.129865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 69/132] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:48 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:49.226911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:49.250055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:49.253276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:49.256076 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a32802b4-5bbc-4ed0-9f5e-853728603954 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 1.039415 Jul 28 02:19:49.257001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 64/133] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:48 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:19:49.558539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-63548b4d-a539-4f98-9698-4c089e8a4e92 req-5ed9f5df-0f40-4d27-8d49-41ee1f798401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839bec7e-f188-482a-83c1-93f7812f1fb6", "tag": "381df188-01c4-4181-92e1-f3df290d4f58"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:49.581139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:49.588176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-63548b4d-a539-4f98-9698-4c089e8a4e92 req-5ed9f5df-0f40-4d27-8d49-41ee1f798401 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:49.588654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-63548b4d-a539-4f98-9698-4c089e8a4e92 req-5ed9f5df-0f40-4d27-8d49-41ee1f798401 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:49.614172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-63548b4d-a539-4f98-9698-4c089e8a4e92 req-5ed9f5df-0f40-4d27-8d49-41ee1f798401 service nova] Creating event network-changed:381df188-01c4-4181-92e1-f3df290d4f58 for instance 839bec7e-f188-482a-83c1-93f7812f1fb6 on hv-cinder-79987 Jul 28 02:19:49.626364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-63548b4d-a539-4f98-9698-4c089e8a4e92 req-5ed9f5df-0f40-4d27-8d49-41ee1f798401 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071915 Jul 28 02:19:49.636140 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 70/134] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:50.151834 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:50.152978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:50.181834 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:50.182732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:50.186478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:50.187854 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:50.285473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:50.286264 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:50.298376 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:50.302413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:50.306083 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:50.306744 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:51.128089 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:51.240672 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:51.258073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:51.262773 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:51.264497 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf7232fb-e39a-473d-99ca-8c932f33d2cd tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.985640 Jul 28 02:19:51.266215 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 71/135] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:50 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:19:51.315040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:51.372717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-10f90586-70be-4405-88cd-260704b80abf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 1.225039 Jul 28 02:19:51.374044 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 65/136] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:50 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:52.293414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:52.294138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:52.306539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:52.306948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:52.316861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:52.318040 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:52.396551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:52.398333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:52.400783 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=14 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:19:52.441658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:52.446973 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:52.450451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:52.454651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:52.807250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:52.822039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:52.831909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:52.837625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-116bea32-dcc5-4dcb-a118-f406a9abc34b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.548865 Jul 28 02:19:52.839847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 72/137] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:52 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:52.865018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:52.880582 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27efe337-d6c4-49ca-ac4f-d27c64ab3198 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.489698 Jul 28 02:19:52.886643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 66/138] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:52 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:19:53.864497 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:53.867521 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:53.891363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:53.902095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:53.906379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:53.911221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:53.911788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:53.914566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:53.942613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:53.943326 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:53.944207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:53.953648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:54.590885 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:54.600123 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-71e602e4-a764-40e9-b608-5fe9793d9fe2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.693710 Jul 28 02:19:54.613546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 67/139] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:53 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:54.617046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:54.632194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-76c4961e-9d2f-428c-86a8-cd03e42005e9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: .version_select at 0x7efc52fa9820>, body: {"keypair": {"name": "tempest-keypair-1314819171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvAgUjrBSua3ojyLjgOonsEIcrFxtv4OwRHGkvDxJ2H2XPSZ446evCMvIlekdKJkyeHnv23KR05GfnZQ5FsJvMPrkqBOW/DeOthY/WZu40muh76DNm9Umm4gXGe67UjEA=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:54.645228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:54.649874 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:54.654191 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-68896019-e3a4-43be-9bb7-f8640366c67f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.792782 Jul 28 02:19:54.655804 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 73/140] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:53 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:54.699586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-76c4961e-9d2f-428c-86a8-cd03e42005e9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:19:54.704903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-76c4961e-9d2f-428c-86a8-cd03e42005e9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:19:54.760740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-76c4961e-9d2f-428c-86a8-cd03e42005e9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145630 Jul 28 02:19:54.763817 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 68/141] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:19:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:19:55.633471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:55.634149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:55.660549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:55.667236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:55.680007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:55.681642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:55.684680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:55.685500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:55.698364 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:55.699147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:55.701689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:55.702532 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:56.205201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:56.207872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:56.217959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-08259ee6-6e8c-42e6-b33d-2ea6bd34c2da tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.596210 Jul 28 02:19:56.223730 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 74/142] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:55 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:56.226990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:56.232296 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:56.238254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-603ff0aa-8d55-41a2-96aa-edff3b145de4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.555478 Jul 28 02:19:56.252942 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 69/143] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:55 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:19:57.247454 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:57.248073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:57.266290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:57.267430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:57.271991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:57.273907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:57.276449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:57.277035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:57.277533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:57.278457 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:57.298148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:57.304781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:57.920317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:57.939827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cd013c68-9ebf-4747-bcb6-66fc464404f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.697427 Jul 28 02:19:57.942670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 75/144] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:57 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:58.257468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:58.275621 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:58.280516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:58.282754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1871f570-f690-441c-b733-521bdb6aaeb1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 1.019683 Jul 28 02:19:58.285112 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 70/145] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:57 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:19:58.689853 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-256332048", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "networks": [{"uuid": "8466f690-6ecd-4c36-b468-10b5b1c31996"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:58.783440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] validate_networks() for [('8466f690-6ecd-4c36-b468-10b5b1c31996', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:19:58.963277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:58.964177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:58.976138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:58.979717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:58.983528 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:58.984266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:59.309986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:19:59.337613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6692f90b-a5ef-4613-b07b-5ee70f814962 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.379112 Jul 28 02:19:59.339585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 71/146] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:19:58 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:19:59.346908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1512536269", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda255f1-8497-41f0-9d65-8f281bd7eb0d"}], "security_groups": [{"name": "tempest-securitygroup--764190808"}], "key_name": "tempest-keypair-1314819171", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:19:59.534826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:19:59.535481 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:19:59.536231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:19:59.536795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:19:59.537506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:19:59.561437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:59.561882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:59.562815 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:59.563277 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:59.580400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] validate_networks() for [('bda255f1-8497-41f0-9d65-8f281bd7eb0d', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:19:59.606184 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Getting quotas for project c8a95d974bc1486c800b91945e600b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:19:59.623773 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Getting quotas for user 3fb609c27e9e4069a079c7fe674bafa0 and project c8a95d974bc1486c800b91945e600b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:19:59.642974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:19:59.646277 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:19:59.755395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62dc70cc-973e-4acc-9848-b42ddb8bdb72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072458 Jul 28 02:19:59.757242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 76/147] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:19:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:19:59.763276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:19:59.764135 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:19:59.773697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:59.774459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:59.775453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:19:59.776032 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:19:59.781929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:00.392776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:00.401492 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:00.410531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:00.411783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c42181b5-6497-4ab3-9d82-cc55da7d686d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.653113 Jul 28 02:20:00.412534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 77/148] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:19:59 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:00.437941 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:00.440161 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:00.450907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:00.451345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:00.459089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:00.459638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:00.861445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:00.870439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-99eab81f-394d-45af-8338-38e0e6b447a4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1217 microversion: 2.1 time: 0.437898 Jul 28 02:20:00.871041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 78/149] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:00 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1217 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:00.901365 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:00.901999 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:00.933288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:00.936467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:00.938642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:00.945751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:01.501601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:20:01.503015 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:20:01.503726 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:20:01.504678 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:20:01.505540 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:20:01.528339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:01.536977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:01.545611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cdb9e038-3601-41ab-8879-4e87c72802d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.673316 Jul 28 02:20:01.546500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:01.552302 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 79/150] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:00 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:01.554475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:01.555272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:01.575552 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:01.577313 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:01.603997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:01.604560 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:01.606600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:01.608637 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:01.629192 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:01.649086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:01.695943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:20:01.698803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:20:01.833272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b7a9aa8c-1c8f-4532-8e8c-817567f65298 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.491957 Jul 28 02:20:01.848270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 72/151] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:19:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:20:01.867413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dbf9e7ff-07ce-4015-9600-51417d054e67 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:01.877447 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dbf9e7ff-07ce-4015-9600-51417d054e67 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:02.021526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:02.038281 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:02.045675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:02.048829 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e3e036b9-5986-4f96-903b-8eb14042440b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.492990 Jul 28 02:20:02.060926 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 80/152] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:01 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:02.060926 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:02.062824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:02.079631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:02.080328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:02.083021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:02.084800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:02.089037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dbf9e7ff-07ce-4015-9600-51417d054e67 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:02.100437 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dbf9e7ff-07ce-4015-9600-51417d054e67 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1242 microversion: 2.1 time: 0.243554 Jul 28 02:20:02.116916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 73/153] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:01 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1242 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:02.248066 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:02.272110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dee9322b-9ff4-4f22-a079-aa44e0b19da1 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1273 microversion: 2.1 time: 0.219310 Jul 28 02:20:02.276342 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 81/154] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:02 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:02.573639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:02.574252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:02.582917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:02.591907 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:02.593062 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:02.593659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.075483 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:03.079435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:03.097788 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.098272 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.101587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.104976 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.146516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.163616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-37a702d0-5357-492a-ae51-99d0fc333cf9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.593120 Jul 28 02:20:03.164651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 74/155] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:02 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:03.184512 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:03.185815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:03.221614 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.222794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.226721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.232962 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.438047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.459433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6b8285b7-cdbe-4337-ae39-cce2a2b670df tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1246 microversion: 2.1 time: 0.287684 Jul 28 02:20:03.462595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 75/156] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:03 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1246 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:03.487127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:03.487826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:03.517949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.518415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.523215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:03.523667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:03.537329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.549187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.551213 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.555022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ab4ff2a1-22ca-4d7c-bea3-142659af5eff tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.485189 Jul 28 02:20:03.559931 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 82/157] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:03 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:03.702178 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:03.716738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ebc549ef-ff6d-4ca2-91a9-cb7ca9b9ed01 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1271 microversion: 2.1 time: 0.250073 Jul 28 02:20:03.717369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 76/158] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:03 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:04.185734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:04.186392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:04.202198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.203274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.205784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.206716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.487461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:04.489291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:04.503572 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:04.510773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.516577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.519497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.520120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.537315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:04.856040 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:04.857387 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:04.867581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7cadec8e-9c84-411b-ae9b-90f50f1f695c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.685669 Jul 28 02:20:04.868517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-31e80566-3ef5-4671-b8f1-1e3bf3834eaa tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1312 microversion: 2.1 time: 0.385444 Jul 28 02:20:04.870242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 83/159] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:04 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:04.878057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 77/160] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:04 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:04.880026 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:04.880612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:04.908602 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:04.909933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:04.910660 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.911372 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.912533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.913520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.921988 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.922465 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:04.930232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:04.930868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:05.732753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:05.750346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:05.756321 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3bb9ff1-7228-453b-bbaa-6676b406ec34 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.861783 Jul 28 02:20:05.757105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 78/161] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:04 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:05.778087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:05.781118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:05.782906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1e291ee8-a4dd-4423-8416-371e93e827ca tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1744 microversion: 2.20 time: 0.911521 Jul 28 02:20:05.783976 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 84/162] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:04 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1744 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:05.790890 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-eb15c335-bd70-487d-ac5a-81ec7bda658a req-57713055-e615-44c7-bf76-5e9995cd1153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fb7f5a-d860-4022-a284-a364155ba3ba", "name": "network-vif-plugged", "status": "completed", "tag": "40d8500a-f1bf-4d76-ab1d-ab85d099d88f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:05.835167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-eb15c335-bd70-487d-ac5a-81ec7bda658a req-57713055-e615-44c7-bf76-5e9995cd1153 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:05.835615 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-eb15c335-bd70-487d-ac5a-81ec7bda658a req-57713055-e615-44c7-bf76-5e9995cd1153 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:05.872925 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-eb15c335-bd70-487d-ac5a-81ec7bda658a req-57713055-e615-44c7-bf76-5e9995cd1153 service nova] Creating event network-vif-plugged:40d8500a-f1bf-4d76-ab1d-ab85d099d88f for instance 57fb7f5a-d860-4022-a284-a364155ba3ba on hv-cinder-79987 Jul 28 02:20:05.890277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-eb15c335-bd70-487d-ac5a-81ec7bda658a req-57713055-e615-44c7-bf76-5e9995cd1153 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131771 Jul 28 02:20:05.890814 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 79/163] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:05.916337 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:05.917081 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:05.918073 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:05.920990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:05.947518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:05.949828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:05.952550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:05.954746 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:05.956239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:05.956904 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:05.958326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:05.962838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:06.316339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:06.332710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65a5f7a5-c07d-47e0-b334-408fa0ce6791 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1300 microversion: 2.1 time: 0.422457 Jul 28 02:20:06.333921 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 80/164] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:05 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1300 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:06.435370 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:06.451650 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0df74925-8f6e-43fd-beec-aae2f862bfd8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 0.543076 Jul 28 02:20:06.452713 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 85/165] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:05 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:06.786158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:06.787077 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:06.803420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:06.804145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:06.809619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:06.810805 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:06.814463 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:06.820321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:06.822204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:06.849487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:06.851884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:06.854605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:07.619038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:07.637479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:07.639102 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:07.640470 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02317428-3884-49cf-addc-8b6c983af79b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.834687 Jul 28 02:20:07.641631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 86/166] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:06 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:07.696183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:07.697296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:07.705717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:07.717827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:07.726605 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4c3d5f87-2d69-4399-96f5-38e0463587cc tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.948095 Jul 28 02:20:07.745927 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 81/167] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:06 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:07.750548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:07.752963 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:07.754009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:07.754629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:07.762553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:07.763404 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:07.803749 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:07.806953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:07.807936 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:07.822471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:08.841797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:08.868472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:08.872257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f49d6590-6c8d-444c-8636-70de33a779ff tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 1.124870 Jul 28 02:20:08.877293 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 82/168] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:07 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:08.884429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-8a32e058-4873-4b11-b71a-2db6cc4104af req-1b6c5c55-8ec7-489a-b076-a5ac591e2e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84182d0b-8573-484f-a608-7e224c01bdf9", "tag": "9026580a-9a93-42a4-b6b5-73328b1a0c05"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:08.891147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-382c4eb6-635a-40c0-a745-041b4cce9919 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 1.247971 Jul 28 02:20:08.893300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 87/169] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:07 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:08.903221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:08.909933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:08.931811 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:08.933454 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:08.935286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:08.942988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:08.993429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8a32e058-4873-4b11-b71a-2db6cc4104af req-1b6c5c55-8ec7-489a-b076-a5ac591e2e5c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:08.999383 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8a32e058-4873-4b11-b71a-2db6cc4104af req-1b6c5c55-8ec7-489a-b076-a5ac591e2e5c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:09.076420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-8a32e058-4873-4b11-b71a-2db6cc4104af req-1b6c5c55-8ec7-489a-b076-a5ac591e2e5c service nova] Creating event network-changed:9026580a-9a93-42a4-b6b5-73328b1a0c05 for instance 84182d0b-8573-484f-a608-7e224c01bdf9 on hv-cinder-79987 Jul 28 02:20:09.122333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-8a32e058-4873-4b11-b71a-2db6cc4104af req-1b6c5c55-8ec7-489a-b076-a5ac591e2e5c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233881 Jul 28 02:20:09.128321 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 83/170] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:09.192911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:09.195253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:09.231446 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:09.234157 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:09.241735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:09.249129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:09.571577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:09.634781 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:10.076597 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:10.107826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:10.112988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:10.114267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1284b734-e479-4384-a4ac-8b703f4e5ff7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 1.219644 Jul 28 02:20:10.122310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 88/171] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:08 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:10.144520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-726fc776-f299-4c34-9c5c-3a7a50b31e92 req-82815da1-497a-44b6-b7d1-28aee00403b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839bec7e-f188-482a-83c1-93f7812f1fb6", "name": "network-vif-plugged", "status": "completed", "tag": "381df188-01c4-4181-92e1-f3df290d4f58"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:10.176527 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-726fc776-f299-4c34-9c5c-3a7a50b31e92 req-82815da1-497a-44b6-b7d1-28aee00403b1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:10.191024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-726fc776-f299-4c34-9c5c-3a7a50b31e92 req-82815da1-497a-44b6-b7d1-28aee00403b1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:10.234290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-726fc776-f299-4c34-9c5c-3a7a50b31e92 req-82815da1-497a-44b6-b7d1-28aee00403b1 service nova] Creating event network-vif-plugged:381df188-01c4-4181-92e1-f3df290d4f58 for instance 839bec7e-f188-482a-83c1-93f7812f1fb6 on hv-cinder-79987 Jul 28 02:20:10.250173 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-726fc776-f299-4c34-9c5c-3a7a50b31e92 req-82815da1-497a-44b6-b7d1-28aee00403b1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120788 Jul 28 02:20:10.255089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 89/172] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:10.307403 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:10.310366 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:10.347927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:10.351673 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:10.356772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:10.362133 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.151617 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.169964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-46442e47-def2-4c23-a199-e72fddfe901d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 2.033119 Jul 28 02:20:11.171771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 84/173] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:09 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:11.189411 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:11.190985 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:11.206634 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:11.208952 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.212031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:11.213890 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.417684 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.435144 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3db5ab64-70f5-4090-b4f1-c69b89f0eb59 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 1.178282 Jul 28 02:20:11.435886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 90/174] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:10 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:11.441943 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c2a0695d-99ea-4b4b-bb47-0496e0789193 req-d1ae8d3f-1456-454a-86d9-8bc62b3beb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606c5aa8-a5d8-4890-b67f-5be4476fea19", "tag": "60dcd1ef-cfe6-44be-bd4d-be1a1761d28d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:11.472801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c2a0695d-99ea-4b4b-bb47-0496e0789193 req-d1ae8d3f-1456-454a-86d9-8bc62b3beb32 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:11.473643 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c2a0695d-99ea-4b4b-bb47-0496e0789193 req-d1ae8d3f-1456-454a-86d9-8bc62b3beb32 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.502060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c2a0695d-99ea-4b4b-bb47-0496e0789193 req-d1ae8d3f-1456-454a-86d9-8bc62b3beb32 service nova] Creating event network-changed:60dcd1ef-cfe6-44be-bd4d-be1a1761d28d for instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 on hv-cinder-79987 Jul 28 02:20:11.510671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c2a0695d-99ea-4b4b-bb47-0496e0789193 req-d1ae8d3f-1456-454a-86d9-8bc62b3beb32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073165 Jul 28 02:20:11.511682 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 91/175] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:11.522427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:11.529816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:11.540732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:11.541317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.542193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:11.542710 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:11.587596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:11.726627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.742893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b2d931dd-f1a5-40cb-b7c0-dcda92be159e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.562690 Jul 28 02:20:11.743789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 85/176] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:11 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:11.790343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6f1bcdfd-2de4-487d-b392-0d4e930a77d8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'create', calling method: .version_select at 0x7efc52fdfca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-173523979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISzKhtepLMO6wLDj9JRmutfTtvD7e7jeUNiw0iHJyoZqUGZbhjwdYBg7kijor8rEL0T4leug5TVIHzULm/tid4j1NKwrw45R0n3oEJyAFCEPuEIrteOIM+OVx6crqpJ4A=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:11.827329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6f1bcdfd-2de4-487d-b392-0d4e930a77d8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Getting quotas for project 9cb7e92c703a42d6be6343c04934d533. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:11.834652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-6f1bcdfd-2de4-487d-b392-0d4e930a77d8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Getting quotas for user c4947dc5e05c42518cd697a3d21643cc and project 9cb7e92c703a42d6be6343c04934d533. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:11.885511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6f1bcdfd-2de4-487d-b392-0d4e930a77d8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.130348 Jul 28 02:20:11.888474 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 86/177] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:20:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:11.903742 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.920736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.923142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:11.924525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d8684102-fdfd-4eda-92cf-54a55b23e476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.411754 Jul 28 02:20:11.925138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 92/178] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:11 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:12.094895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-570477722", "imageRef": "d04bbeac-6683-4b7a-8e61-e6492ad77e3d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-173523979", "networks": [{"uuid": "645f8645-b726-4be7-bb5a-32ec9ab88df5"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:12.193698 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:12.194585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:12.238734 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] validate_networks() for [('645f8645-b726-4be7-bb5a-32ec9ab88df5', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:20:12.240373 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:12.242553 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:12.246607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:12.248342 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:12.842952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:12.861954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a162abb5-b530-4be5-9578-34286ace7d22 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.672041 Jul 28 02:20:12.873490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 93/179] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:12 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:12.891341 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5c712183-b4f6-4e10-aa8a-7828e59f89a7 req-02e4b7a2-46eb-4bfc-83b7-a3ee2991068a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "name": "network-vif-plugged", "status": "completed", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:12.915105 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5c712183-b4f6-4e10-aa8a-7828e59f89a7 req-02e4b7a2-46eb-4bfc-83b7-a3ee2991068a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:12.915549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5c712183-b4f6-4e10-aa8a-7828e59f89a7 req-02e4b7a2-46eb-4bfc-83b7-a3ee2991068a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:12.945435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5c712183-b4f6-4e10-aa8a-7828e59f89a7 req-02e4b7a2-46eb-4bfc-83b7-a3ee2991068a service nova] Creating event network-vif-plugged:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:20:12.966022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-5c712183-b4f6-4e10-aa8a-7828e59f89a7 req-02e4b7a2-46eb-4bfc-83b7-a3ee2991068a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089690 Jul 28 02:20:12.967399 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 94/180] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:12.976237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:12.977360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:12.986810 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:12.987706 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:12.988733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:12.989441 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.159907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:14.164472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:14.170594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dadc0f86-16c4-440f-8fcb-7f323a076ab6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1322 microversion: 2.1 time: 1.201072 Jul 28 02:20:14.171977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 95/181] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:12 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1322 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:14.199038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:14.203265 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:14.239969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.241220 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.245339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.248969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.535547 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:20:14.537582 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:20:14.539017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:20:14.539633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:20:14.540222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:20:14.563510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.573267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.576270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.579468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.650022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Getting quotas for project 9cb7e92c703a42d6be6343c04934d533. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:14.663339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Getting quotas for user c4947dc5e05c42518cd697a3d21643cc and project 9cb7e92c703a42d6be6343c04934d533. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:14.703759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:20:14.706464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d04bbeac-6683-4b7a-8e61-e6492ad77e3d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:20:14.810698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-70d6d87b-cccd-478c-a30d-96d343a8b3ea tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.719714 Jul 28 02:20:14.811933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 87/182] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:20:14.829565 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:14.830592 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:14.844586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.845527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:14.847412 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:14.849482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:15.035824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:15.053098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-39b903bd-ea23-4108-8617-eb9db865cd4e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.879375 Jul 28 02:20:15.067005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 96/183] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:14 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:15.076855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:15.077521 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:15.104312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:15.105190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:15.106189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:15.106925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:15.251448 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:15.275520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:15.279740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:15.286399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9ef6ed00-1b81-44a0-ab85-798a9597538b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.472056 Jul 28 02:20:15.293037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 88/184] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:14 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:15.305409 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-576581ea-dd01-4b87-910c-2a99d73934d9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:15.307855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-576581ea-dd01-4b87-910c-2a99d73934d9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:15.946985 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-576581ea-dd01-4b87-910c-2a99d73934d9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:15.964839 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-576581ea-dd01-4b87-910c-2a99d73934d9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1257 microversion: 2.1 time: 0.668705 Jul 28 02:20:15.967737 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 89/185] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:15 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1257 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:15.993485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:15.997343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:16.025195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.027245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.034215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.041385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.139884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.166518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4c15d51e-7f90-46f7-9ac4-38d7adc0c951 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 1.109029 Jul 28 02:20:16.183351 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 97/186] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:15 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:16.207288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-55908a48-7583-406c-9ef0-28d8e9926b00 req-e9cd44d8-11af-4963-b867-65a573e2c1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182d0b-8573-484f-a608-7e224c01bdf9", "name": "network-vif-plugged", "status": "completed", "tag": "9026580a-9a93-42a4-b6b5-73328b1a0c05"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:16.236343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-55908a48-7583-406c-9ef0-28d8e9926b00 req-e9cd44d8-11af-4963-b867-65a573e2c1ec service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.237225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-55908a48-7583-406c-9ef0-28d8e9926b00 req-e9cd44d8-11af-4963-b867-65a573e2c1ec service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.294653 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-55908a48-7583-406c-9ef0-28d8e9926b00 req-e9cd44d8-11af-4963-b867-65a573e2c1ec service nova] Creating event network-vif-plugged:9026580a-9a93-42a4-b6b5-73328b1a0c05 for instance 84182d0b-8573-484f-a608-7e224c01bdf9 on hv-cinder-79987 Jul 28 02:20:16.307317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-55908a48-7583-406c-9ef0-28d8e9926b00 req-e9cd44d8-11af-4963-b867-65a573e2c1ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117110 Jul 28 02:20:16.311534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 98/187] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:16.325776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:16.326542 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:16.336750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.337234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.338992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.339486 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.482213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.502718 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ec00e454-9930-45b0-bf9f-66395949ac63 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1517 microversion: 2.1 time: 0.532311 Jul 28 02:20:16.503313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 90/188] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:15 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1517 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:16.507930 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:16.508544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:16.527815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.528266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.529267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.529921 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.773516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.792234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a92c042-dc57-4211-a175-98bc1a919c0e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.479290 Jul 28 02:20:16.793188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 99/189] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:16 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:16.799870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:16.805556 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:16.818693 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.826933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.828085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:16.830076 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:16.867462 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.869013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'flavor' on Instance uuid 839bec7e-f188-482a-83c1-93f7812f1fb6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:20:16.876623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.878201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:16.882253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-69b3436b-a2a6-4899-92c8-7f6451387d3c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.375087 Jul 28 02:20:16.882860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 91/190] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:16 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:16.968482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-53e93eaa-29a1-4bb4-8986-437dd930a7f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6/action" status: 200 len: 32 microversion: 2.1 time: 0.173792 Jul 28 02:20:16.971186 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 100/191] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:20:16 2022] POST /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:20:16.983558 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:16.984175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:17.000993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:17.001721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.002235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:17.003373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.004205 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.004649 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.018156 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.021064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.022162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.034313 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.149954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:17.182961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62458569-9446-48af-8106-94a3de0633fd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1317 microversion: 2.1 time: 0.188915 Jul 28 02:20:17.183804 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 101/192] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:16 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:17.191326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:17.201087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:17.211895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.214013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.215031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.215730 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.322382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:17.339575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9524a078-6c95-4ef7-8d19-b715ea10301c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.362664 Jul 28 02:20:17.340739 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 92/193] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:16 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:17.407416 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:17.428082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5f8ceb3b-9c3a-4972-83bf-7b03f955c8e8 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.238697 Jul 28 02:20:17.429362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 102/194] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:17 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:17.662965 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7905b4a2-6dcb-41de-ae79-b4b180955813 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Action: 'create', calling method: .version_select at 0x7efc52f441f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-822063328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClQTMuFNF78g1HdIbr00svCRIBH1OJNKlyMDWbUmgfJE9fBuQA5pmGrPDissUy1j8zWlOo2x0RSuP/SC/HLu0Cwl3nKEOx84qy0xFTMJ83zHifShSxkfOsYVfYV99Bh6g=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:17.689492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-7905b4a2-6dcb-41de-ae79-b4b180955813 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for project 551ad4a52e754c83a0215409f09a21a8. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:17.696561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-7905b4a2-6dcb-41de-ae79-b4b180955813 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for user dc1b1c277f9d4f9d8224a03201d3bb38 and project 551ad4a52e754c83a0215409f09a21a8. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:17.732840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7905b4a2-6dcb-41de-ae79-b4b180955813 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.339982 Jul 28 02:20:17.742892 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 93/195] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:20:17 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:20:17.822759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:17.823766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:17.831792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.834752 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.834752 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.834752 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.913687 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:17.916006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:17.931187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.933416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:17.937453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:17.940032 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.029313 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.041753 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a715f5eb-5762-41d0-bc88-70a206294ed7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.222637 Jul 28 02:20:18.043961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 103/196] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:17 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:18.184649 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.197001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.205102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.208909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5f76aab8-cbb2-4faf-92c2-62e92fa8ea5e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.306265 Jul 28 02:20:18.210570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 94/197] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:17 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:18.237424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:18.240152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:18.261425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.265233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.266685 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.269632 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.366910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:18.367522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:18.382940 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.383404 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.384194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.384668 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.433889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.443263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5d09a349-81ef-45cb-8198-fe26b09159ce tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1317 microversion: 2.1 time: 0.234462 Jul 28 02:20:18.480388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 104/198] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:18 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:18.487728 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:18.488348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:18.516931 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.519064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.521266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:18.521670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:18.948866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.983831 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:18.995060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c8c1f28-541d-48c3-a130-96c9c41f82aa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.631801 Jul 28 02:20:18.997153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 95/199] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:18 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:19.013766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a2ec081-dfed-4a20-ae0c-0eba036353ae tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.531906 Jul 28 02:20:19.014757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 105/200] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:18 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:19.066131 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:19.067038 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:19.083117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:19.084055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:19.085124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:19.085784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:19.242051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:19.245906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:19.264439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:19.265051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:19.271605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:19.271605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.110860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:20.125419 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-45a63d9e-0658-4a7f-8abb-a867c198a224 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 1.065294 Jul 28 02:20:20.161212 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 96/201] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:19 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:20.175845 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:20.184060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:20.204700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.213577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.220085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.220709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.332290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:20.346962 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:20.361003 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:20.362230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fbde04fb-0444-41f3-b89a-51160fe1ba36 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 1.124555 Jul 28 02:20:20.366427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 106/202] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:19 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:20.381386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:20.387118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:20.399958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.400670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.401635 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.407970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.562275 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:20.593339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65fdbc25-cdfb-44c6-a515-41f5ff4b4e57 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1315 microversion: 2.1 time: 0.429821 Jul 28 02:20:20.601026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 97/203] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:20 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:20.616127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:20.624377 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:20.637394 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.642738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:20.646320 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:20.650844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.090772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:21.098101 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:21.109975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-860f8045-4cfd-434f-a46a-a7df06182721 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1313 microversion: 2.1 time: 0.507226 Jul 28 02:20:21.114509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 98/204] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:20 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:21.150771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:21.151757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:21.164251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.168445 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.169433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.170163 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.613202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:21.635460 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-29a51841-0a1e-400e-8fd1-c13c54e35521 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 1.261431 Jul 28 02:20:21.645371 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 107/205] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:20 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:21.660362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:21.661293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:21.672503 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.673122 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.682004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.682674 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.896856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:21.905901 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1f72f9cf-def3-4d30-a4fc-bfd409a5a81f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.761415 Jul 28 02:20:21.917697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 99/206] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:21 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:21.925201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:21.944309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:21.959010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.974719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:21.976700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:21.977430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.157339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:22.182794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:22.189435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:22.222531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf27c323-03e6-40a2-a642-56a19ec76349 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.575832 Jul 28 02:20:22.223506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 108/207] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:21 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:22.236616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:22.242428 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:22.259047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.277226 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.280573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.287257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.592097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:22.618754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a8d7f773-d776-4aa9-a715-43e8c1284e8e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.697847 Jul 28 02:20:22.639102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 100/208] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:21 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:22.665497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-c321b1dc-44fe-4d1c-91fd-650ce3d9a9f4 req-5b9b9e50-6964-4b85-ae2a-baeac0312117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606c5aa8-a5d8-4890-b67f-5be4476fea19", "name": "network-vif-plugged", "status": "completed", "tag": "60dcd1ef-cfe6-44be-bd4d-be1a1761d28d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:22.689740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c321b1dc-44fe-4d1c-91fd-650ce3d9a9f4 req-5b9b9e50-6964-4b85-ae2a-baeac0312117 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.692863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c321b1dc-44fe-4d1c-91fd-650ce3d9a9f4 req-5b9b9e50-6964-4b85-ae2a-baeac0312117 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.733745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-c321b1dc-44fe-4d1c-91fd-650ce3d9a9f4 req-5b9b9e50-6964-4b85-ae2a-baeac0312117 service nova] Creating event network-vif-plugged:60dcd1ef-cfe6-44be-bd4d-be1a1761d28d for instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 on hv-cinder-79987 Jul 28 02:20:22.748611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-c321b1dc-44fe-4d1c-91fd-650ce3d9a9f4 req-5b9b9e50-6964-4b85-ae2a-baeac0312117 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107323 Jul 28 02:20:22.751005 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 101/209] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:22.770222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:22.773023 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:22.785984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.791238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.792361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.799134 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.904546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:22.922932 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff7b977d-eccd-41dc-8322-fbb65fdab928 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1496 microversion: 2.1 time: 0.695134 Jul 28 02:20:22.926919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 109/210] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:22 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1496 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:22.950776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:22.951472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:22.979933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.981363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:22.983140 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:22.987423 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:23.133431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:23.151426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8cc94482-6439-404b-b332-5a872fbfb546 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.398348 Jul 28 02:20:23.152510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 102/211] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:22 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:23.248729 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:23.249683 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:23.270812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:23.277783 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:23.279082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:23.280758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:23.524344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:23.546313 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6e8e08e8-93f0-43ca-845b-af6df52ad9bc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.609934 Jul 28 02:20:23.562977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 110/212] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:22 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:23.647104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:23.648345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:23.669493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:23.671072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:23.673039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:23.677922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:23.747044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:24.530957 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:24.561569 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:24.590940 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:24.593258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-204b07e2-0c20-44b5-935d-b5625e3bc7c9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 1.349795 Jul 28 02:20:24.596571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 103/213] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:23 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:24.603922 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:24.604953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:24.619531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:24.623670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.624124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.625468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.626061 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.651325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:24.660449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-42b39e53-ce20-4d98-a6e6-0815f29013ad tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 1.017622 Jul 28 02:20:24.669089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 111/214] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:23 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:24.685821 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-975c6a8b-aca6-49d7-95b5-fef0132597bb req-28f25729-c4c6-48e6-a5e6-a83139c2d4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:24.719854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-975c6a8b-aca6-49d7-95b5-fef0132597bb req-28f25729-c4c6-48e6-a5e6-a83139c2d4a9 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.725618 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-975c6a8b-aca6-49d7-95b5-fef0132597bb req-28f25729-c4c6-48e6-a5e6-a83139c2d4a9 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.727246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:20:24.791772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-975c6a8b-aca6-49d7-95b5-fef0132597bb req-28f25729-c4c6-48e6-a5e6-a83139c2d4a9 service nova] Creating event network-changed:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:20:24.799535 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-975c6a8b-aca6-49d7-95b5-fef0132597bb req-28f25729-c4c6-48e6-a5e6-a83139c2d4a9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128912 Jul 28 02:20:24.800592 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 112/215] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:24.811297 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:24.812711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:24.821310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.823683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.825114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.825825 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.931082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3f16d56a-e1eb-43b2-8dfa-fd92c0e27104 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "DELETE /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 204 len: 0 microversion: 2.1 time: 0.332563 Jul 28 02:20:24.936832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 104/216] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:20:24 2022] DELETE /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:20:24.944934 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:24.945859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:24.950124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:24.958598 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.959363 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:24.960207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:24.961028 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.313644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:25.336897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4857cd26-a0fe-47eb-aeda-4ec98caca966 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.398144 Jul 28 02:20:25.337846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 105/217] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:24 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:25.343103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:25.343835 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:25.363528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:25.377075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-19eb1fee-bc29-40a2-bc37-f2b734e11ecf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.572448 Jul 28 02:20:25.379241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 113/218] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:24 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:25.380716 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.381347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.382154 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.382648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.642676 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:25.643389 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:25.691743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.693613 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.699924 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.700797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.722420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:25.739431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1d8da38-62a1-4210-bbe4-f9bde1c56686 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.399590 Jul 28 02:20:25.743174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 106/219] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:25 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:25.765060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:25.766472 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:25.787737 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.790561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:25.796372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:25.798622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:26.422922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:26.458679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:26.468285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:26.478080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8a3e6e06-de39-4dae-8344-52a650507a85 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.852954 Jul 28 02:20:26.514210 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 114/220] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:25 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:26.525821 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:26.531317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:26.566473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:26.567222 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:26.572769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:26.588048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-293a59c3-bf2a-41c5-9c00-2488f3390812 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.821580 Jul 28 02:20:26.588048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 107/221] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:25 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:26.588436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:26.588436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:26.607565 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:26.612184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:26.636410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:26.636967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:26.639779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:26.642225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.035209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:27.049560 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:27.077688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e70ff8b3-6997-416b-8d35-ceef709be28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.499477 Jul 28 02:20:27.080530 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 108/222] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:26 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:27.081751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0105723e-8aa8-4f46-a95b-2a3f3dc86e55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.557403 Jul 28 02:20:27.085103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 115/223] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:26 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:27.099562 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:27.112098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:27.134724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.135733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.137353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.138433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.441751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:27.451373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14a38653-5ab3-4ddf-84c8-fcb4d980056c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.367541 Jul 28 02:20:27.458501 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 109/224] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:27 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:27.522909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:27.524580 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:27.543249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.548732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.550534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.554655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.616991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:27.619544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:27.634224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.635250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.636571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:27.637427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:27.708052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=28 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:28.122310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.149815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.183616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.188668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.195684 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-66695bf4-ce9e-4dcc-bd1d-d71d1eb6ae75 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.584318 Jul 28 02:20:28.196162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-de12003a-7de8-499a-b810-09506ef2ea57 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.675861 Jul 28 02:20:28.212989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 116/225] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:27 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:28.213769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:28.214667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 110/226] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:27 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:28.216761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:28.237429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:28.238035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:28.240003 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.240918 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.249203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.252504 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.252993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.254080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.263014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.263464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.796533 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.805219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7c5c1ba2-ed4f-492f-b9e1-90f959834dbd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.589173 Jul 28 02:20:28.823170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 111/227] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:28 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:28.828313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:28.834495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:28.847657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.848452 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.849993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:28.856235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:28.860932 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:28.868715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-55b612ae-39f4-4c08-a3f8-5912cb900e13 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.668750 Jul 28 02:20:28.873629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 117/228] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:28 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:29.120838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:29.144910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-678bdad7-26a7-449f-bc45-91545881e66d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.310245 Jul 28 02:20:29.144910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 112/229] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:28 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:29.233303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:29.234957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:29.246545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:29.247167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:29.253621 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.254876 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.257341 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.257794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.258772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.260179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.263672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.264495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.817462 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:29.826862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:29.832107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:29.838581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-241d341c-6ccc-45ba-9b5e-e8f18236d140 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.605155 Jul 28 02:20:29.840727 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 118/230] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:29 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:29.848028 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:29.849357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:29.850151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:29.861595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aefd1ed4-6ea9-427b-b12e-59a8d95ee275 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.616717 Jul 28 02:20:29.866041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.873987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.877548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.878130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 113/231] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:29 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:29.881657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.899985 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:29.901613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:29.926561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.938332 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.940464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:29.941619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:29.998769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:30.388510 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:30.403222 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e7c7c7fd-105d-4b00-8719-b38533168d51 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.558790 Jul 28 02:20:30.408898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 119/232] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:29 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:30.414199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:30.419368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:30.439153 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:30.439611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:30.440402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:30.440833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:30.623653 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:30.652032 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-841c2d0e-fea3-43ba-895c-d77613189947 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.758474 Jul 28 02:20:30.654980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 114/233] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:29 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:30.871033 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:30.872385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:30.881223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:30.881921 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:30.883108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:30.883748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.024602 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.037413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1064a61d-0306-436c-8bab-ab3a480fcf72 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.626702 Jul 28 02:20:31.041267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 120/234] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:30 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:31.057174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:31.061496 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:31.103035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.105819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.105819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.105819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.297664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.315799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.318223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.319931 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-55e5103e-4295-4093-ac3b-2793821e5f5b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.455835 Jul 28 02:20:31.349438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 115/235] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:30 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:31.429796 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:31.430766 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:31.438081 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.439003 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.440031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.440790 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.463823 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.479356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec1f7330-fcf3-4681-9dd2-cc405eb79eb8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.435185 Jul 28 02:20:31.483340 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 121/236] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:31 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:31.660711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:31.670179 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e3494b66-8d04-4872-99f5-78d8c6221cd9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.244188 Jul 28 02:20:31.671164 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 116/237] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:31 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:31.708222 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:31.709677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:31.721287 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.721980 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:31.724415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:31.725617 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.021939 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:32.035826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ffb9920-92ca-4578-9d5a-96839aa38981 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.331274 Jul 28 02:20:32.041404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 122/238] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:31 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:32.103190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:32.103808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:32.128344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.128753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.129866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.130453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.361176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:32.361794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:32.377523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.378006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.378750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.379178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.642840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:32.649954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:32.661319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11e37064-4bb0-42d9-a584-21f03bc9e38c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.562832 Jul 28 02:20:32.665838 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:32.671066 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:32.682386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f7acee2-9d32-4fc5-ab54-54988d6564ce tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.331280 Jul 28 02:20:32.682812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 117/239] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:32 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:32.687013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 123/240] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:32 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:32.690900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:32.691724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:32.705412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:32.706288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:32.714811 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.716483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.725639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.726744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.727331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.732533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:32.733664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:32.735158 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.479968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:33.492897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-93e27eaa-c954-45e4-a7a7-6a3cfb35718f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.808637 Jul 28 02:20:33.497813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 118/241] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:32 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:33.503505 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:33.504824 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:33.506955 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:33.516856 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a47c948a-2bab-4328-9715-7ee1db548cf9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.827811 Jul 28 02:20:33.517690 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 124/242] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:32 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:33.521043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.521493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.522673 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.523277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.699108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:33.700636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:33.708435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.709199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.710182 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.710917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.832453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:33.840679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-95cdf3eb-ee81-4225-9ede-4f5a213daebd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.341660 Jul 28 02:20:33.857950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 119/243] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:33 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:33.857950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:33.857950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:33.867130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.867470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.868239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:33.868716 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:33.957633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:33.968169 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-048abefc-4081-4104-82c4-c864ce5050df tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.272873 Jul 28 02:20:33.983011 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 125/244] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:33 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:34.118214 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:34.131180 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:34.134425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:34.137215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-977e60e7-6657-411f-a05a-adec9d4ab631 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.290181 Jul 28 02:20:34.146226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 120/245] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:33 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:34.522136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:34.522932 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:34.529884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.530426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.533982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.534703 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.539007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:34.540270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:34.550097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.550839 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.552243 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.552864 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.842379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:34.862343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-807d7d21-fcc4-414c-b994-79ab8081fc54 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.346920 Jul 28 02:20:34.863144 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 126/246] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:34 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:34.874371 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:34.877733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-388065a8-e106-448e-bb31-4e06dcbed718 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.341446 Jul 28 02:20:34.885278 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 121/247] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:34 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:34.885512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:34.885512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:34.890935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.891484 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.892340 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:34.892954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:34.995531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:34.997006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:35.019207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.019632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.020436 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.020948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.067615 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:35.083325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ae0e9cb1-6999-4bd2-91a8-47bc0ab3e921 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.217387 Jul 28 02:20:35.083919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 127/248] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:34 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:35.172221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:35.173840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:35.182397 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.183393 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.184939 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.185828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.244802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:35.356567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:35.370448 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aa4bbc21-6ece-4b3b-90f7-156afabe055d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.380139 Jul 28 02:20:35.385046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 122/249] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:34 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:35.442237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:35.451286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:35.453484 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:35.455069 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ff5b472-7afc-4dbf-9d27-814af24ad65d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.288901 Jul 28 02:20:35.455649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 128/250] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:35 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:35.885250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:35.885871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:35.894463 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.894924 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.897947 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.901014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.904245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:35.904929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:35.912604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.913405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:35.914638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:35.915266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.174538 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.193010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11b303ae-0380-4311-abba-89d28409dc13 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.309123 Jul 28 02:20:36.193750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 123/251] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:35 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:36.202092 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:36.203406 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:36.216220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.226351 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.228340 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.230358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.272791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.288994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a3eaf11b-5c40-4106-aa50-d8f1b47c0c69 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1367 microversion: 2.1 time: 0.383826 Jul 28 02:20:36.288994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 129/252] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:35 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:36.394530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:36.395191 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:36.404083 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.407753 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.409190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.409848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.480222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.488536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c87fa03d-6b03-4f47-bcda-7f5c0ea50baf tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.293638 Jul 28 02:20:36.489262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 124/253] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:36 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:36.494125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:36.494956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:36.502873 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.503707 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.504799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:36.505443 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:36.654256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.667128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-29e132fc-5943-4e78-98b5-62ae542afffa tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.278566 Jul 28 02:20:36.669761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 130/254] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:36 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:36.725507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.736603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.738047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:36.739247 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2822d732-5cd5-4ed0-845b-01e8516240c7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1739 microversion: 2.20 time: 0.248705 Jul 28 02:20:36.753143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 125/255] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:36 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:37.219266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:37.220130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:37.226872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.227317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.228112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.228530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.310540 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:37.312713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:37.320238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.321301 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.322440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.323098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.599491 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:37.607502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-447b2ab0-dbdc-4132-9aab-b7a117b88ae1 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.392590 Jul 28 02:20:37.620277 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 131/256] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:37 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:37.634473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:37.635293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:37.645693 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.647030 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.648048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.648702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.658969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:37.668631 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3b927c84-7e0a-4aa2-aba9-90ceac3dfa33 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1557 microversion: 2.1 time: 0.362306 Jul 28 02:20:37.670935 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 126/257] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:37 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1557 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:37.692169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:37.693097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:37.703328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.704051 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:37.705189 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:37.705939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.002010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:38.010787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-20f6708f-1ebc-4931-958b-49af19564fa8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.388109 Jul 28 02:20:38.011805 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 132/258] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:37 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:38.019480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:38.020343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:38.027447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=92 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:38.030116 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.031001 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.032037 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.032695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.074261 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:38.092366 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-345bce49-0c50-4b93-9954-5b0708dabf77 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 200 len: 1502 microversion: 2.1 time: 0.403891 Jul 28 02:20:38.094040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 127/259] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:37 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:38.099892 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:38.100714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:38.112521 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.113975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.114986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.115670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.228551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5456fb43-ca85-4d4a-b76a-6886ce3e5f10 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215326 Jul 28 02:20:38.240565 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 133/260] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:20:38 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:38.472392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-f1cd8005-1589-4b20-ba18-6f35864638ff req-3fc679fd-e5d4-43a3-85ca-e1090a7b3250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84182d0b-8573-484f-a608-7e224c01bdf9", "name": "network-vif-deleted", "tag": "9026580a-9a93-42a4-b6b5-73328b1a0c05"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:38.494772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f1cd8005-1589-4b20-ba18-6f35864638ff req-3fc679fd-e5d4-43a3-85ca-e1090a7b3250 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.495503 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f1cd8005-1589-4b20-ba18-6f35864638ff req-3fc679fd-e5d4-43a3-85ca-e1090a7b3250 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.520375 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-f1cd8005-1589-4b20-ba18-6f35864638ff req-3fc679fd-e5d4-43a3-85ca-e1090a7b3250 service nova] Creating event network-vif-deleted:9026580a-9a93-42a4-b6b5-73328b1a0c05 for instance 84182d0b-8573-484f-a608-7e224c01bdf9 on hv-cinder-79987 Jul 28 02:20:38.532401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-f1cd8005-1589-4b20-ba18-6f35864638ff req-3fc679fd-e5d4-43a3-85ca-e1090a7b3250 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065012 Jul 28 02:20:38.533761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 134/261] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:20:38.643220 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:38.644580 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:38.669244 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.671309 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.675356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:38.676194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:38.833896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:38.844684 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:38.846833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:38.848439 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4bf6cb6-5241-4bba-bf60-95c884386397 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1721 microversion: 2.20 time: 0.753077 Jul 28 02:20:38.867069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 128/262] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:38 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1721 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:39.043920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:39.045089 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:39.059894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:39.060902 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:39.062964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:39.064008 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:39.332703 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:39.341512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3aae8988-8f41-4d81-8d7e-16aa7b874390 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.715827 Jul 28 02:20:39.342702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 135/263] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:38 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:39.348750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:39.349985 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 84182d0b-8573-484f-a608-7e224c01bdf9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:39.369609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:39.370463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:39.378782 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:39.379809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:39.419395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] HTTP exception thrown: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Request method failure captured: Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 HTTP/1.1 Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fJMzWW2eFbOTJw-cFu8aucK-z2cFd5vKCFcTIlpvmwy9r88Fhh8ZVyvAGuDyDa71El6COnNiG6z7JrBLHsxomSNipk9R_HuyqG_WzxMrKsl81vw-8ERpsAAvcTz4loQHTlSV4wcDpueJQNlz6BJhdicjEol6n4cyAhYvZ1FvQdWMJU Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: c8a95d974bc1486c800b91945e600b7d Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-1562917228 Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:20:39.423575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-1562917228 Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: c8a95d974bc1486c800b91945e600b7d Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-1562917228 Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-1562917228-project Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 3fb609c27e9e4069a079c7fe674bafa0 Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-1562917228-project Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. Jul 28 02:20:39.425029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '84182d0b-8573-484f-a608-7e224c01bdf9'} Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:20:39.425977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. Jul 28 02:20:39.427445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:20:39.430327 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Returning 404 to user: Instance 84182d0b-8573-484f-a608-7e224c01bdf9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:20:39.431453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-56df629a-6cb1-4209-8ef2-b0259f13abe2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9" status: 404 len: 111 microversion: 2.1 time: 0.086525 Jul 28 02:20:39.435868 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 136/264] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:39 2022] GET /compute/v2.1/servers/84182d0b-8573-484f-a608-7e224c01bdf9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:20:39.705054 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1891149211", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "networks": [{"uuid": "8466f690-6ecd-4c36-b468-10b5b1c31996"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:39.893932 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] validate_networks() for [('8466f690-6ecd-4c36-b468-10b5b1c31996', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:20:40.163543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:40.177252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f6d0607b-934f-4073-8bd7-040b9fa2d33f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 1.138372 Jul 28 02:20:40.180167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 129/265] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:39 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:40.203281 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:40.211348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:40.231525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:40.233295 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:40.239099 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:40.241991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:41.446889 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:41.467691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:41.470162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:41.471485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5a4f87b2-0580-4054-9122-fed8552b03c1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1721 microversion: 2.20 time: 1.274414 Jul 28 02:20:41.485443 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 130/266] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:40 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1721 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:41.490151 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b3b70dac-bd3e-49a1-915a-c81e911e65c1 req-f24afbb4-0b22-4420-9497-9fa1038d2048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "name": "network-vif-unplugged", "status": "completed", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:41.509641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b3b70dac-bd3e-49a1-915a-c81e911e65c1 req-f24afbb4-0b22-4420-9497-9fa1038d2048 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:41.510137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b3b70dac-bd3e-49a1-915a-c81e911e65c1 req-f24afbb4-0b22-4420-9497-9fa1038d2048 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:41.515749 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:41.547075 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b3b70dac-bd3e-49a1-915a-c81e911e65c1 req-f24afbb4-0b22-4420-9497-9fa1038d2048 service nova] Creating event network-vif-unplugged:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:20:41.558417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b3b70dac-bd3e-49a1-915a-c81e911e65c1 req-f24afbb4-0b22-4420-9497-9fa1038d2048 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084428 Jul 28 02:20:41.559404 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 131/267] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:41.564906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:41.565677 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:41.591171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:41.591666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:41.592697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:41.593914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.009567 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:20:42.010164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:20:42.010608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:20:42.011206 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:20:42.011657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:20:42.029053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.029530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.030388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.031496 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.094801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Getting quotas for project c8a95d974bc1486c800b91945e600b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:42.100917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Getting quotas for user 3fb609c27e9e4069a079c7fe674bafa0 and project c8a95d974bc1486c800b91945e600b7d. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:42.142498 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:20:42.145477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:20:42.227935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-18fc8836-36a1-4145-9ccc-06e9b15ee566 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.529609 Jul 28 02:20:42.229368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 137/268] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 02:20:42.239947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:42.241185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:42.251583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.252271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.253253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.254012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.514784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:42.541651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-324c301e-fb8a-4244-9695-ad40265dd017 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.981106 Jul 28 02:20:42.556898 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 132/269] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:41 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:42.561522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4e2db89-8305-404e-968d-fe433867b751 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:42.563026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4e2db89-8305-404e-968d-fe433867b751 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:42.768786 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:42.782929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7b24a656-70b7-4cfe-ac9d-b1edc64399d8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.552109 Jul 28 02:20:42.797952 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4e2db89-8305-404e-968d-fe433867b751 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:42.799254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 138/270] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:42 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:42.811361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4e2db89-8305-404e-968d-fe433867b751 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1214 microversion: 2.1 time: 0.262635 Jul 28 02:20:42.813275 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 133/271] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:42 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:42.840456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:42.841620 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:42.881494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.882307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:42.883522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:42.884285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.090265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-625b39de-d3a5-4928-bbfb-71c7cd87eb7e req-0eb98ceb-b4f0-419f-8db9-f08276447839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606c5aa8-a5d8-4890-b67f-5be4476fea19", "tag": "60dcd1ef-cfe6-44be-bd4d-be1a1761d28d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:43.152550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-625b39de-d3a5-4928-bbfb-71c7cd87eb7e req-0eb98ceb-b4f0-419f-8db9-f08276447839 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.159786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-625b39de-d3a5-4928-bbfb-71c7cd87eb7e req-0eb98ceb-b4f0-419f-8db9-f08276447839 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.192482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-625b39de-d3a5-4928-bbfb-71c7cd87eb7e req-0eb98ceb-b4f0-419f-8db9-f08276447839 service nova] Creating event network-changed:60dcd1ef-cfe6-44be-bd4d-be1a1761d28d for instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 on hv-cinder-79987 Jul 28 02:20:43.200568 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-625b39de-d3a5-4928-bbfb-71c7cd87eb7e req-0eb98ceb-b4f0-419f-8db9-f08276447839 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116744 Jul 28 02:20:43.201535 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 134/272] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:43.278228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:43.301425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:43.308922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:43.310626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ad6c0e5-e3d3-44b1-99b5-92fd61491486 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1721 microversion: 2.20 time: 0.499817 Jul 28 02:20:43.311441 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 139/273] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:42 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1721 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:43.573748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:43.580239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:43.591644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.592519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.594893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.595721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.613060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-de4855b4-f63c-4b83-9584-28f76e2602ab req-7dc79bea-5d4f-4468-97d9-3324e2e7e29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "name": "network-vif-plugged", "status": "completed", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:43.632776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-de4855b4-f63c-4b83-9584-28f76e2602ab req-7dc79bea-5d4f-4468-97d9-3324e2e7e29b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.633270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-de4855b4-f63c-4b83-9584-28f76e2602ab req-7dc79bea-5d4f-4468-97d9-3324e2e7e29b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.660181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-de4855b4-f63c-4b83-9584-28f76e2602ab req-7dc79bea-5d4f-4468-97d9-3324e2e7e29b service nova] Creating event network-vif-plugged:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:20:43.673961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-de4855b4-f63c-4b83-9584-28f76e2602ab req-7dc79bea-5d4f-4468-97d9-3324e2e7e29b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067840 Jul 28 02:20:43.676793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 140/274] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:20:43.771158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:43.780386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-40d312e7-bab8-42ff-a1fb-d2ae024589ec tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.218751 Jul 28 02:20:43.783043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 135/275] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:43 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:43.817101 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:43.818120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:43.828107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.828947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.830442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.831094 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.845209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:43.845975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:43.868209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.868840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:43.873766 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:43.874959 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.301959 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:44.314038 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e985ec0c-9900-4bc5-8633-3c662b3e28a7 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1218 microversion: 2.1 time: 0.477394 Jul 28 02:20:44.317510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 136/276] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:43 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1218 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:44.349847 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:44.351060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:44.370165 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.371238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.373597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.376337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.458832 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:44.471739 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6736f0b3-5e52-4bc6-96d4-09c2fb4ec493 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.663219 Jul 28 02:20:44.477543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 141/277] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:43 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:44.728284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:44.736658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:44.738236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:44.749694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7e03449-a10d-4649-943b-32ca17966c5f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1724 microversion: 2.20 time: 0.407292 Jul 28 02:20:44.759344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 137/278] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:44 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:44.789035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fca5363-3ad9-4155-8e6f-48ce496db8bc"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:44.791683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:44.801691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:44.802602 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:44.816229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.818344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.822523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.823245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.823573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.824290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:44.830439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:44.831490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.044740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:45.061146 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9de91bef-37b5-4850-a46f-92f5b88d306b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.263348 Jul 28 02:20:45.062770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 138/279] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:44 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:45.306467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f3f8ba9c-5427-44f5-bba6-fbe1f70cf724 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.523956 Jul 28 02:20:45.307290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 142/280] 10.222.0.40 () {62 vars in 1364 bytes} [Thu Jul 28 02:20:44 2022] POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments => generated 188 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:20:45.346116 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:45.346997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:45.363479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.366386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3dd814c1-a17b-45ad-970a-a3aed7bf7e12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Action: 'create', calling method: .version_select at 0x7efc52fba9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-672939744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSynnc0y9cdu1ccKMEIA6A9gQUaXewT1962iOeifGOrTnKwAAaO5RS4C9QGQGR1cxMKW6eGYytqEdP4ntkwEJZ9D7rzXSmuqKmmbC+d166xoyo0vvQzYnhrAUREMUfpnQ=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:45.369639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.370537 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.370989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.421315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-3dd814c1-a17b-45ad-970a-a3aed7bf7e12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Getting quotas for project 723a88dd0d514e9080b5355da878b406. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:45.435158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-3dd814c1-a17b-45ad-970a-a3aed7bf7e12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Getting quotas for user 1ce471a0d92f4985b7d071078f30f1bc and project 723a88dd0d514e9080b5355da878b406. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:45.494292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3dd814c1-a17b-45ad-970a-a3aed7bf7e12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.430075 Jul 28 02:20:45.495346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 139/281] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:20:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:45.508390 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:45.513522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:45.529471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.530039 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.538464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.538928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.611476 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:45.624037 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-334adf15-7895-407b-a749-7971afc5d070 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1266 microversion: 2.1 time: 0.286781 Jul 28 02:20:45.625075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 143/282] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:45 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:45.630178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:45.630775 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:45.652507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.652980 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.653764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.654201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.720856 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117787) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 02:20:45.785338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:45.805319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:45.822124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-87d84ce9-16e9-431b-b9c7-871a46676c88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.318665 Jul 28 02:20:45.825642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-af4ea9b9-99ca-43f5-866b-07925d503204 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/action" status: 202 len: 0 microversion: 2.20 time: 0.199262 Jul 28 02:20:45.826638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 144/283] 10.222.0.40 () {62 vars in 1319 bytes} [Thu Jul 28 02:20:45 2022] POST /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:20:45.829486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 140/284] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:45 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:45.855699 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:45.856396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:45.864170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.864624 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:45.865976 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:45.866605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:46.001999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1595021538", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-822063328", "security_groups": [{"name": "tempest-secgroup-smoke-115564651"}], "block_device_mapping_v2": [{"uuid": "63770741-866c-43e1-99d3-b8697562aac1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a862076-171d-4686-a6b7-e646e42fd313"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:46.400833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] validate_networks() for [('6a862076-171d-4686-a6b7-e646e42fd313', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:20:46.461147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:46.475333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:46.480281 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:46.488760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ef2df0a5-caa5-4515-9ebf-30d5635ae0c2 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1750 microversion: 2.20 time: 0.656177 Jul 28 02:20:46.507411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 145/285] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:45 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1750 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:46.524683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:46.526585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:46.538056 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:46.538899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:46.540015 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:46.540791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:46.873783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:46.888945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26ad6e03-568e-40d0-aa44-5a79f95680c6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1357 microversion: 2.1 time: 0.378436 Jul 28 02:20:46.890002 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 146/286] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:46 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1357 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:46.895281 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:46.896136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:46.911522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:46.912070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:46.912866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:46.913404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.628417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:47.637436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-41039041-569a-4260-b138-809a0a17ad61 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.745750 Jul 28 02:20:47.638246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 147/287] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:46 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:47.644450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:47.645341 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:47.656011 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.656827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.657799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.658414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.659330 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:20:47.660485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:20:47.661992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:20:47.663042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:20:47.664494 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:20:47.698449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.702700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.703680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.704133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.731477 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:20:47.736486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for user dc1b1c277f9d4f9d8224a03201d3bb38 and project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:20:47.828818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:20:47.831010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63770741-866c-43e1-99d3-b8697562aac1',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:20:47.866267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:47.877551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7f4fde6c-3174-48b3-bce0-573a43eb73fd tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.237878 Jul 28 02:20:47.879169 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 148/288] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:47 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:47.885121 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:47.886311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:47.894871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.896012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:47.897060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:47.897792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.019372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:48.048690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-68a7b5bd-2d8c-4b0d-aba5-446e9f2c93fa tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.053451 Jul 28 02:20:48.049417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 141/289] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:20:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:20:48.065772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:48.066546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:48.076749 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.087748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.089358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.090157 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.090603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.093605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.096654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.101694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ed6c42c-6a12-4e49-8fe5-a8cc9a5af2e5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1750 microversion: 2.20 time: 0.220787 Jul 28 02:20:48.102577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 149/290] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:47 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:48.108635 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60ccd9c7-de04-4478-8817-e4d282641cc6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:48.109501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60ccd9c7-de04-4478-8817-e4d282641cc6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:48.201971 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-60ccd9c7-de04-4478-8817-e4d282641cc6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.211070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60ccd9c7-de04-4478-8817-e4d282641cc6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1094 microversion: 2.1 time: 0.107088 Jul 28 02:20:48.227934 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 150/291] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:48 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:48.384415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.397090 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2eb67b4d-6489-464a-9509-815d02594d11 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1547 microversion: 2.1 time: 0.346109 Jul 28 02:20:48.399433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 142/292] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:48 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1547 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:48.422194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:48.422811 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:48.435850 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.437546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.439409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.440225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.679322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:48.680727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:48.688108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.696478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.696478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.696478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.765961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.775773 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ebeaa69a-fa04-4423-b9ba-9f50c04d26cc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1547 microversion: 2.1 time: 0.358307 Jul 28 02:20:48.777500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 151/293] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:48 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1547 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:48.810014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:48.821996 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:48.822988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Searching by: {'deleted': False, 'project_id': '9cb7e92c703a42d6be6343c04934d533'} {{(pid=117787) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 02:20:48.832307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.832764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:48.833683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:48.834128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.134695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.137982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.multi_cell_list [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 02:20:49.145496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e3e72d5a-e8b8-43ee-8a7f-57c612d0cd02 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.470976 Jul 28 02:20:49.148132 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 143/294] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:48 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:49.161652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:49.165688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:49.182991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.183549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.184846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.186818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.358995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e07ba0ca-5547-4395-a044-5be13a22eb5b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.561750 Jul 28 02:20:49.372731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 152/295] 10.222.0.40 () {58 vars in 1125 bytes} [Thu Jul 28 02:20:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:49.381038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:49.381942 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:49.388525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.389329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.391378 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.392308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.435633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.445533 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e45a9c6-bb56-4df6-a250-59e2ccbb0945 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1523 microversion: 2.1 time: 0.296198 Jul 28 02:20:49.452041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 144/296] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:49 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:49.460520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:49.462303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:49.479442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.480205 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.481019 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.481457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.586254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.598326 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-652a9e35-1ab2-4f76-aa72-2b30d56f6a7c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1136 microversion: 2.1 time: 0.144289 Jul 28 02:20:49.599452 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 145/297] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:49 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1136 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:49.619059 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:49.619941 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:49.627608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.628064 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.629004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.629915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.787466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.800196 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.802118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.804372 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-457006b2-3426-4c41-a6d1-c8210062d4c0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1752 microversion: 2.20 time: 0.430221 Jul 28 02:20:49.805490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 153/298] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:49 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1752 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:49.811024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1c51f423-be33-4059-b3dc-42548c3c8878 req-144a1dc2-559d-44e0-ab24-7215157a2676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b5fd75-2db3-46be-8264-36011d52c8a9", "tag": "6e132d86-41ff-4554-a4c5-042a10ca9f6c"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:49.844137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1c51f423-be33-4059-b3dc-42548c3c8878 req-144a1dc2-559d-44e0-ab24-7215157a2676 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:49.844831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1c51f423-be33-4059-b3dc-42548c3c8878 req-144a1dc2-559d-44e0-ab24-7215157a2676 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:49.871389 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1c51f423-be33-4059-b3dc-42548c3c8878 req-144a1dc2-559d-44e0-ab24-7215157a2676 service nova] Creating event network-changed:6e132d86-41ff-4554-a4c5-042a10ca9f6c for instance 26b5fd75-2db3-46be-8264-36011d52c8a9 on hv-cinder-79987 Jul 28 02:20:49.877978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1c51f423-be33-4059-b3dc-42548c3c8878 req-144a1dc2-559d-44e0-ab24-7215157a2676 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071352 Jul 28 02:20:49.880776 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:49.881666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 154/299] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:49.889979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0cae753f-21f5-4798-bd6f-fdf7bd691f79 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1547 microversion: 2.1 time: 0.275670 Jul 28 02:20:49.891561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 146/300] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:49 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1547 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:50.188170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:50.191269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:50.207919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.209969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.211693 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.213090 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.470436 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:50.471158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:50.472611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:50.479650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.480243 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.481234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-18e21a6d-14db-4e4a-a766-3f4736cf1ef6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.300698 Jul 28 02:20:50.481727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.482061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 155/301] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:50 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:50.493622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.649781 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:50.652304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:50.669976 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.670702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.680506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.681284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.738317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:50.755276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4dfb7aaf-724e-4b65-ba1f-5d31f65fd652 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1503 microversion: 2.1 time: 0.289333 Jul 28 02:20:50.755939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 147/302] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:50 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:50.799927 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:50.800560 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:50.815939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.816497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.817371 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.817869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.840465 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:50.854630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c77918af-46ec-4d9b-af52-84637d7dd8ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1192 microversion: 2.1 time: 0.235709 Jul 28 02:20:50.877916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 156/303] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:50 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1192 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:50.895486 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:50.896184 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:50.931388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.933819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:50.943557 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:50.947645 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:51.569596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:51.586265 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:51.591333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:51.599881 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:51.606751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-87b41b35-b4b8-4860-abd7-030e6fc71f96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.713763 Jul 28 02:20:51.607418 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 157/304] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:50 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:51.618190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-703ec353-01bc-4dcc-8d74-8f1cffd754fc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1516 microversion: 2.1 time: 0.826344 Jul 28 02:20:51.623294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 148/305] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:50 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1516 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:51.632445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:51.633627 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:51.646831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:51.650479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:51.651464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:51.654115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:51.910415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:51.911354 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:51.923232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:51.923793 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:51.924625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:51.925097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:52.122499 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:52.139384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:52.167335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a50c26d0-75b0-4f6f-bbe4-d0effeef0e30 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1210 microversion: 2.1 time: 0.260968 Jul 28 02:20:52.169235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-25d73572-3995-4167-871a-cf0c7d17333f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.554019 Jul 28 02:20:52.172690 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 158/306] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:51 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:52.173174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 149/307] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:51 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1210 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:52.184468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89250cc4-965e-40d6-b058-889dd692215b"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:52.195541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:52.216012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:52.217178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:52.219521 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:52.220185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:52.650222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:52.650880 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:52.661135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:52.662028 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:52.663208 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:52.663847 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:52.831497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:52.840513 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:52.842356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:52.844231 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2fb66272-7601-47b5-a639-194e90996dbe tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.204927 Jul 28 02:20:52.845449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 150/308] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:52 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:20:53.139189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1819d116-a28f-4e14-947d-c0a3733fe5ff tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963667 Jul 28 02:20:53.140968 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 159/309] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:20:52 2022] POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:53.204022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:53.206121 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:53.207724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:53.211927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:53.238347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.240276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.240847 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.242068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.242228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.242807 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.244777 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.245300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.528574 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:53.551851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0553d000-357a-4dc8-81a2-17b83cc93109 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1198 microversion: 2.1 time: 0.355891 Jul 28 02:20:53.553489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 160/310] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:53 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1198 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:53.567889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:53.574666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:53.592348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.594551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.595775 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.596477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.603036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:53.628496 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'flavor' on Instance uuid 57fb7f5a-d860-4022-a284-a364155ba3ba {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:20:53.679482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:53.711647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:53.730799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1b7c2104-2408-4580-9d44-03abcc9d953e tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.541263 Jul 28 02:20:53.736396 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 151/311] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:53 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:53.752575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-475afcd0-ee04-43b7-bd23-5a64f28aef2d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/action" status: 200 len: 32 microversion: 2.1 time: 0.197169 Jul 28 02:20:53.753809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 161/312] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:20:53 2022] POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:20:53.766096 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:53.767130 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:53.781316 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.781553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.782469 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.785342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.883707 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:53.884866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:53.898151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.898902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:53.900287 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:53.901151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:54.156365 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:54.173910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5fe1e404-e5f4-4600-9194-d3f7a815bc57 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.414573 Jul 28 02:20:54.181773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 152/313] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:53 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:54.252987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:54.268972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:54.278409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:54.279927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0da80239-f4e6-495d-8c8e-a85fb54977b5 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.406164 Jul 28 02:20:54.280918 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 162/314] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:53 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:54.574982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:54.576004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:54.595919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:54.597858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:54.602795 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:54.603803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:54.760269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:54.761115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:54.785550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:54.789424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:54.790654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:54.796392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:54.994786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:55.017102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2fad74e2-4934-4e6d-b81b-03192e90816a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.444599 Jul 28 02:20:55.018883 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 153/315] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:54 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:55.164712 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:55.178360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-78ef17b7-0eda-4fda-98b6-9aeb0fbcadfd tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.426577 Jul 28 02:20:55.179154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 163/316] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:54 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:55.219134 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:55.220721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:55.236040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:55.236825 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:55.238878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:55.239874 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:55.312707 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:55.318029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:55.347324 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:55.348507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:55.350460 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:55.351482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.396642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.409942 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.411438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.413564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc025454-d07e-4484-a9e4-880bcd6a4c78 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 1.109605 Jul 28 02:20:56.414322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 164/317] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:55 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:56.419638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:56.421206 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:56.430296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.431078 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.432062 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.432702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.444209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.455867 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ee849733-4f81-4d73-96bd-8a7081a29da3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 1.255423 Jul 28 02:20:56.478669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 154/318] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:55 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:56.484428 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-c9b962a5-8dd8-44df-9bef-4536ea44537a req-c892567d-9be5-4aca-848f-2ba83b0ffe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b5fd75-2db3-46be-8264-36011d52c8a9", "name": "network-vif-plugged", "status": "completed", "tag": "6e132d86-41ff-4554-a4c5-042a10ca9f6c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:56.495017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c9b962a5-8dd8-44df-9bef-4536ea44537a req-c892567d-9be5-4aca-848f-2ba83b0ffe4e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.495761 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c9b962a5-8dd8-44df-9bef-4536ea44537a req-c892567d-9be5-4aca-848f-2ba83b0ffe4e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.521071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-c9b962a5-8dd8-44df-9bef-4536ea44537a req-c892567d-9be5-4aca-848f-2ba83b0ffe4e service nova] Creating event network-vif-plugged:6e132d86-41ff-4554-a4c5-042a10ca9f6c for instance 26b5fd75-2db3-46be-8264-36011d52c8a9 on hv-cinder-79987 Jul 28 02:20:56.531379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-c9b962a5-8dd8-44df-9bef-4536ea44537a req-c892567d-9be5-4aca-848f-2ba83b0ffe4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051090 Jul 28 02:20:56.532213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 155/319] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:56.537137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:56.537894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:56.546839 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.547571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.548566 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.549271 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.681997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.699193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a387fd6b-c909-4037-bbbc-928ebb968d51 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.283611 Jul 28 02:20:56.719155 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 165/320] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:56 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:56.724548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-f0c38874-07d7-4e8a-bdf5-73739f13729d req-97a46f8a-59d4-401d-a73d-ee325741c148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e", "tag": "d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:20:56.752608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f0c38874-07d7-4e8a-bdf5-73739f13729d req-97a46f8a-59d4-401d-a73d-ee325741c148 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:56.753415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f0c38874-07d7-4e8a-bdf5-73739f13729d req-97a46f8a-59d4-401d-a73d-ee325741c148 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:56.767859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:56.777903 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-f0c38874-07d7-4e8a-bdf5-73739f13729d req-97a46f8a-59d4-401d-a73d-ee325741c148 service nova] Creating event network-changed:d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df for instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e on hv-cinder-79987 Jul 28 02:20:56.784742 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-f0c38874-07d7-4e8a-bdf5-73739f13729d req-97a46f8a-59d4-401d-a73d-ee325741c148 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063794 Jul 28 02:20:56.785384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8f6aea24-cd34-4082-8a0e-b7e72ac1747f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.252156 Jul 28 02:20:56.786235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 166/321] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:20:56.798844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 156/322] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:56 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:57.440249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:57.441787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:57.448367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.448915 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.449877 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.450319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.485785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:57.487165 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:57.494850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.495577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.496486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.497190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.650704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:57.667075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:57.668979 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:57.670391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3e322c56-4b84-4207-badc-d11ec31fe6ae tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.235665 Jul 28 02:20:57.671931 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 167/323] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:57 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:57.693064 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:57.702140 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9700162f-c25b-42a9-ba69-5936ad88d0dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.220529 Jul 28 02:20:57.703249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 157/324] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:57 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:57.728235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:57.729862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:57.738991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.739633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.740530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.741137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.809633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:57.813007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:57.816050 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:57.817393 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=12 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:57.823775 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.824522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.825751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:57.826543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:57.933090 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:57.941679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a972074-f477-44aa-bd3a-47621c198ea8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.218613 Jul 28 02:20:57.951548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 168/325] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:57 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:58.008505 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:58.017943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c97c0be3-f437-41e9-a3aa-ad4b610eb2b6 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.215488 Jul 28 02:20:58.018717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 158/326] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:57 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:20:58.698072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:58.698777 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:58.700655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:58.707157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:58.708111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:58.709577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:58.710564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:58.726965 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:58.728584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:58.737054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:58.737624 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:58.738547 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:58.739052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:58.972568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:20:58.989445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:58.993206 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:59.003653 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06bf2923-e1e3-40bd-a55d-c7913a0b4513 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.281746 Jul 28 02:20:59.004238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 159/327] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:58 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:59.011921 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:59.013507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:59.015372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:59.018645 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:59.019867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-17bcf865-9516-4a8f-80ab-e84a1c75c562 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.325682 Jul 28 02:20:59.020456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 169/328] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:20:58 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:20:59.024562 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:59.025091 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:59.025870 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:59.026372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:59.041147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:20:59.041754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:20:59.065153 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:59.065723 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:59.066740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:20:59.067188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:20:59.271470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:59.279105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8dc551f1-6eb2-4d82-ade0-640c039c79af tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.273804 Jul 28 02:20:59.280007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 160/329] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:59 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:20:59.287519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:20:59.296463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5b897b25-9019-4174-8893-d12296d10328 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.258928 Jul 28 02:20:59.297189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 170/330] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:20:59 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:00.026744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:00.027626 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:00.041708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.042169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.042958 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.043401 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.048482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:00.049883 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:00.057762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.058561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.059658 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.060157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.274270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.282425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-35f97527-2218-435d-b6ae-2b338b05f655 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.259501 Jul 28 02:21:00.283004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 161/331] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:00 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:00.292112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.301240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:00.301694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.301836 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:00.303267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.304412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bce36b92-594e-4ee1-8f98-cdad2a4e555e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.262727 Jul 28 02:21:00.304990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 171/332] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:00 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:00.307948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.308416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.309418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.309618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.319436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:00.320299 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:00.323653 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:00.330614 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.331451 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.332312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:00.332828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:00.534745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.544081 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7aded5b6-7901-4df7-aa23-6938f75ffe04 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.246567 Jul 28 02:21:00.546920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 162/333] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:00 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:00.548815 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:00.565279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a00c20ac-424f-47d7-b4dd-4869f576cc17 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.250527 Jul 28 02:21:00.565862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 172/334] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:00 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:01.304610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:01.305268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:01.312852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.313372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.314148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.314622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.329803 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:01.330562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:01.346740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.347195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.347987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.348425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.521520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.529132 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0e42d4b6-e295-4c7f-8a2e-257ebd36cafc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.228133 Jul 28 02:21:01.530238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 163/335] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:01 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:01.558304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.567609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:01.567867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.568216 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:01.569413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.570765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-afb99115-aae5-4dd2-a9ce-284bfa61e070 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.245443 Jul 28 02:21:01.571357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 173/336] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:01 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:01.576306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.577438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.578290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.578757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.593755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:01.594395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:01.600803 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.601314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.602084 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:01.602513 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:01.809319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.814177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:01.821982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2d3aea50-5442-4e85-ade7-38890201f352 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.258102 Jul 28 02:21:01.822820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 164/337] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:01 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:01.825552 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-38c6504a-b013-4c10-aa71-4aab5c0adff5 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.237764 Jul 28 02:21:01.826269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 174/338] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:01 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:02.551079 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:02.551734 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:02.558650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.559183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.560551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.561618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.594149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:02.595617 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:02.602344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.602795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.603563 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.604211 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.803159 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:02.810108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:02.810571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23268402-0fa4-4c30-9729-695ed3129aaa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.263520 Jul 28 02:21:02.813026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 165/339] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:02 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:02.819619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:02.821173 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:02.822628 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-82248ec3-5b87-4958-bf67-2c7872bbcbde tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.232893 Jul 28 02:21:02.836232 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 175/340] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:02 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:02.849320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:02.851488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:02.852115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:02.854420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:02.860484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.860966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.862204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.862432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.862792 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.862899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.863650 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:02.864094 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:02.883679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:03.079302 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:03.083199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:03.095245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c4e1801-91f8-4afb-addd-8d7f18c248e8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.255127 Jul 28 02:21:03.109788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 166/341] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:02 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:03.112534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-592a8263-362c-4bfd-843c-7ec72b56d2c2 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.270236 Jul 28 02:21:03.113343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 176/342] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:02 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:03.833484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:03.834215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:03.840667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:03.841235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:03.841987 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:03.842886 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:03.848081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:03.849046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:03.855887 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:03.856706 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:03.857717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:03.858307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:04.078494 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.091176 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a928640-94e6-4fc3-a9c8-4c5b7696709d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.261547 Jul 28 02:21:04.092005 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 167/343] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:03 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:04.114177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.116987 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:04.117735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:04.125758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:04.126313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:04.126994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.127410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:04.127874 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:04.128975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.130374 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d5528310-9030-47ca-8c8f-c6693ddd188f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.286874 Jul 28 02:21:04.131150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 177/344] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:03 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:04.138129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:04.145604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:04.159186 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:04.159640 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:04.160412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:04.160845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:04.401517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.406145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:04.410757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-04a6759b-2a97-4dde-a3ab-84d444435a64 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.297677 Jul 28 02:21:04.411713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 168/345] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:04 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:04.418261 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9964f0c5-3592-4a04-add4-796ca2589d6c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.285485 Jul 28 02:21:04.429448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 178/346] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:04 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:05.118644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:05.119251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:05.127170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.127549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.128331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.128797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.133137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:05.157946 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:05.158684 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:05.164889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.165344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.166104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.166590 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.325425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.341470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a704bbff-849b-45f7-8024-7b858fc5e8b1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.226598 Jul 28 02:21:05.342221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 169/347] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:05 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:05.347784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.356431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.358051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.359300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fce957f7-b3ca-4253-8d94-f66434bee476 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.207644 Jul 28 02:21:05.359841 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 179/348] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:05 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:05.433287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:05.433820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:05.439445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:05.440138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:05.440831 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.441429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.442212 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.442648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.446137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.446593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.447362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:05.447798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:05.653390 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.654237 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1adf4de8-fc5a-4d31-b437-9cd1a4de1585 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.224789 Jul 28 02:21:05.654964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 170/349] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:05 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:05.659073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:05.666506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5b28a2c3-274b-46c1-a776-cb4b9004120a tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.231436 Jul 28 02:21:05.667071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 180/350] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:05 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:06.364591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:06.365234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:06.372855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.373391 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.375155 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.381975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.382839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:06.383516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:06.390298 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.390750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.391517 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.392122 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.585964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.594812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac25a5d9-2f6c-4b63-a5c8-889dc814b02f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.234768 Jul 28 02:21:06.603611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 171/351] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:06 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:06.609190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.629182 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.630719 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.631920 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da10c724-9853-4471-a8c6-f8f5972fb220 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.253036 Jul 28 02:21:06.632475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 181/352] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:06 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:06.676082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:06.676781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:06.683332 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.684247 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.685368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.686833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.688867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:06.689508 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:06.695834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.696279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.697077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:06.697537 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:06.898339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.902704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:06.906870 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-646bcd44-d7c0-48bf-829b-07aa6d37fc05 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.234830 Jul 28 02:21:06.907754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 172/353] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:06 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:06.912042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-069cea45-2e79-4b65-a99b-884d7e0b0102 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.228287 Jul 28 02:21:06.912612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 182/354] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:06 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:07.630150 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:07.630751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:07.637584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.638029 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.638783 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.639331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.656690 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:07.657572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:07.663958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.664413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.665267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.665649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.874358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:07.882863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5d69a674-99a1-4dce-b1ff-f99f2f319c04 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.257479 Jul 28 02:21:07.883821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 173/355] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:07 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:07.907569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:07.917754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:07.919437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:07.921280 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02111c67-9d05-43eb-9589-a2134fb8ae1b tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.269630 Jul 28 02:21:07.922129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 183/356] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:07 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:07.930655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:07.931384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:07.941628 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.942234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.943265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.943798 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.944364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:07.945061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:07.951233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.951734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:07.952550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:07.953021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.143241 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:08.151390 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6047570e-c1ce-495d-939d-7d0ca9189582 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.225458 Jul 28 02:21:08.152470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 174/357] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:07 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:08.156698 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:08.164493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e6084c14-825a-4f16-9f45-e27db4521795 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.226474 Jul 28 02:21:08.165187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 184/358] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:07 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:08.676311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:08.677069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:08.684865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.685359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.687467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.688229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.903817 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:08.904946 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:08.911912 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.912359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.914024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.914024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.944250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:08.953056 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1472234c-d250-4fa3-8472-ffb9bec9502b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1593 microversion: 2.1 time: 0.280709 Jul 28 02:21:08.953657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 175/359] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:08 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1593 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:08.958542 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:08.959155 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:08.965818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.966277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:08.967867 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:08.968392 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:09.128402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.141789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-23e7cce5-a790-4280-b28a-fa4fc3ee1473 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.241850 Jul 28 02:21:09.150448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 185/360] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:08 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:09.159914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.174812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:09.175137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.175430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:09.177100 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.178963 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-701aef53-e286-42a8-a2f3-6695b82878ee tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.223846 Jul 28 02:21:09.179789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 176/361] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:08 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:09.182230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:09.183283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:09.184069 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:09.184507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:09.185221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:09.185990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:09.193033 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:09.193688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:09.194584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:09.195129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:09.486761 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.495139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3b1fcba2-477e-45a8-9958-378234703066 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1314 microversion: 2.1 time: 0.313941 Jul 28 02:21:09.495816 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 177/362] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:09 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:09.503816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:09.521236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-633f6f03-d364-4f72-b8eb-b83bcfda7962 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.351495 Jul 28 02:21:09.522422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 186/363] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:09 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:09.585352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2017378440", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-672939744", "security_groups": [{"name": "tempest-secgroup-smoke-841420297"}], "networks": [{"uuid": "3028137f-378b-4f43-9bf1-434ecd477647"}], "block_device_mapping_v2": [{"uuid": "5a57f2ca-f636-4dc7-992c-3a59e5fd75ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:09.711543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] validate_networks() for [('3028137f-378b-4f43-9bf1-434ecd477647', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:21:10.166577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:10.167380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:10.178964 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.179571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.180449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.181246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.194105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:21:10.195171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:21:10.195869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:21:10.198133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:21:10.198580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:21:10.209145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.209587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.210410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.210850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.235036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Getting quotas for project 723a88dd0d514e9080b5355da878b406. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:21:10.240200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Getting quotas for user 1ce471a0d92f4985b7d071078f30f1bc and project 723a88dd0d514e9080b5355da878b406. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:21:10.316920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:21:10.319016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a57f2ca-f636-4dc7-992c-3a59e5fd75ee',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:21:10.331734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:10.340703 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-91b741d7-b8f1-4b35-8982-cbea34f8fdf1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.180745 Jul 28 02:21:10.341541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 187/364] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:10 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:10.348039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:10.349209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:10.355829 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.356736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.358868 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.359447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.542662 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:10.544303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9fbe604-358e-4d8e-944a-382c6410b5da tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.963059 Jul 28 02:21:10.554858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 178/365] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:21:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:21:10.554858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:10.554858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:10.562803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.563249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.564253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.569314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.574005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:10.593152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:10.595692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b14a3b21-364c-465b-95e1-54236864ad53 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.251693 Jul 28 02:21:10.596944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 188/366] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:10 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:10.613892 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:10.617390 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:10.628808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.630283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:10.633347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:10.634407 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.090535 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.111124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-96dc3971-897a-4afe-9e29-8771975d911c tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1498 microversion: 2.1 time: 0.563251 Jul 28 02:21:11.111858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 179/367] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:10 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1498 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:11.117025 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ee26f995-47de-40e8-96c5-292f0400f590 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:11.117982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ee26f995-47de-40e8-96c5-292f0400f590 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:11.220333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ee26f995-47de-40e8-96c5-292f0400f590 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.239093 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ee26f995-47de-40e8-96c5-292f0400f590 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1088 microversion: 2.1 time: 0.125492 Jul 28 02:21:11.240913 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 180/368] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:11 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1088 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:11.259665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.279204 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fa4745bd-c60e-42c7-9455-6dcf77956b8c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.680611 Jul 28 02:21:11.291944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 189/369] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:10 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:11.367694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:11.368826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:11.391699 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.392424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.393813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.394417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.578911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.587030 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-84c7d61a-cba9-4b9d-beea-24c747e80941 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.225846 Jul 28 02:21:11.587703 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 181/370] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:11 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:11.620241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:11.620860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:11.628259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.628917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.629802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.630242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.760369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:11.761331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:11.766541 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:11.771021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.771983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.773172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.773897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.832113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.832402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:21:11.843411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.845145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:11.846494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6cd2ceec-8639-4c45-ade4-187a806921f3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.230177 Jul 28 02:21:11.847178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 190/371] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:11 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:11.855677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5b57b769-1a99-4ed4-b94b-3b898db852cb req-7ab0382a-c560-4bbc-ba3d-baeffce526bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:11.866504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5b57b769-1a99-4ed4-b94b-3b898db852cb req-7ab0382a-c560-4bbc-ba3d-baeffce526bf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:11.867319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5b57b769-1a99-4ed4-b94b-3b898db852cb req-7ab0382a-c560-4bbc-ba3d-baeffce526bf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:11.880516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5b57b769-1a99-4ed4-b94b-3b898db852cb req-7ab0382a-c560-4bbc-ba3d-baeffce526bf service nova] Creating event network-changed:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:21:11.887109 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-5b57b769-1a99-4ed4-b94b-3b898db852cb req-7ab0382a-c560-4bbc-ba3d-baeffce526bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038181 Jul 28 02:21:11.888289 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 191/372] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:12.004515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-345db715-8213-4507-80e1-5ad1ccd70a3d tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "DELETE /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 204 len: 0 microversion: 2.1 time: 0.241182 Jul 28 02:21:12.024171 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:12.025383 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:12.030026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 182/373] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:21:11 2022] DELETE /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 02:21:12.034987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.035785 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.037125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.037748 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.267503 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:12.268530 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:12.278161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.278680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.280906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.281639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.295966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:12.331048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-90882f2b-b592-429c-984e-25069d5ef534 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1504 microversion: 2.1 time: 0.309883 Jul 28 02:21:12.332436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 192/374] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:12 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:12.342582 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:12.343645 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:12.352381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.353626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.355415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.356151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.429387 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:12.439798 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-94624d8c-e759-4aee-bb94-a238733d4f56 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1186 microversion: 2.1 time: 0.179536 Jul 28 02:21:12.440811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 183/375] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:12 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1186 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:12.577085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:12.582479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:12.588168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-909d7270-ce29-4077-b696-8aa259dae449 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.253947 Jul 28 02:21:12.589129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 193/376] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:12 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:12.622517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:12.624279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:12.637252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.638095 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.640179 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.641298 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.807561 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:12.817303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4a71aced-26b5-4a48-bafc-f8e334e3e28a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.209706 Jul 28 02:21:12.818515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 184/377] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:12 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:12.872061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:12.872849 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:12.880046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.880799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:12.881808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:12.882425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.038778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:13.048558 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:13.050736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:13.051978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-58cd1845-5260-4e07-a7b2-c501d268d493 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.185285 Jul 28 02:21:13.052777 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 194/378] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:12 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:13.246606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1151990054"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:13.247161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:13.254006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.254485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.255271 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.255713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.366224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:13.367114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:13.376717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.377355 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.378284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.378802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.440219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.network.security_group_api [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Adding security group 0df0a0cc-736e-439c-8afe-793336d59f6c to port 69119806-930f-400d-b217-df9b4467529b Jul 28 02:21:13.633304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:13.648063 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-23eb1489-6c8e-4ef9-9abe-1a35900717d4 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1504 microversion: 2.1 time: 0.285634 Jul 28 02:21:13.649015 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 195/379] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:13 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:13.657802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:13.658617 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:13.667179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.667643 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.668459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.669087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.755357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:13.763323 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f3273e8-90a3-40f0-8a3a-cbc97057fbca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1186 microversion: 2.1 time: 0.112642 Jul 28 02:21:13.764479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 196/380] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:13 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:13.769339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:13.770325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:13.777304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.778061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:13.778907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:13.779578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.018205 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.029773 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-97bab58b-a6ee-4c8a-9541-c2224c23be25 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.263906 Jul 28 02:21:14.031159 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 197/381] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:13 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:14.050910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:14.051572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:14.058668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.059114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.061256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.061256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.106039 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-24515975-b0be-46ba-a153-e21c75ca3c91 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.863838 Jul 28 02:21:14.107013 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 185/382] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:21:13 2022] POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:14.113375 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:14.114303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:14.123242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.123925 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.124826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.125350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.130577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:14.345120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.353814 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf0d0424-80c9-42ec-93b4-77cc980755d7 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.321307 Jul 28 02:21:14.363049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 198/383] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:14 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:14.369367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:14.370500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:14.383415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.384468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.390655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.393758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.394375 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.400910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.402587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.403915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-78da9811-ca47-4b6f-a5df-27d86723770f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.295684 Jul 28 02:21:14.406706 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 186/384] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:14 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:14.416937 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-6d01f001-83a1-4077-8d56-4657390a8103 req-15a4faf8-d3bb-412e-b398-a44f13a47dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:14.430882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6d01f001-83a1-4077-8d56-4657390a8103 req-15a4faf8-d3bb-412e-b398-a44f13a47dde service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.431791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6d01f001-83a1-4077-8d56-4657390a8103 req-15a4faf8-d3bb-412e-b398-a44f13a47dde service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.452185 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-6d01f001-83a1-4077-8d56-4657390a8103 req-15a4faf8-d3bb-412e-b398-a44f13a47dde service nova] Creating event network-changed:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:21:14.460566 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-6d01f001-83a1-4077-8d56-4657390a8103 req-15a4faf8-d3bb-412e-b398-a44f13a47dde service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053852 Jul 28 02:21:14.461849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 187/385] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:14.583046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.591506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-75679238-82e4-487e-8b49-e50a7f0b4e23 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1640 microversion: 2.1 time: 0.235122 Jul 28 02:21:14.593312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 199/386] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:14 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1640 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:14.672659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:14.673313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:14.680288 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.680742 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.681780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.682234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.795512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:14.797404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:14.805969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.807049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.808288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:14.809120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:14.856167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.874104 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-45a62e15-3feb-4402-8ded-8482436b3487 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1504 microversion: 2.1 time: 0.206660 Jul 28 02:21:14.886265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 188/387] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:14 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:14.905975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:14.920671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5582f8b6-625c-467b-9388-4ea88379ac80 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1186 microversion: 2.1 time: 0.129610 Jul 28 02:21:14.921516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 200/388] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:14 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1186 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:15.053061 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:15.053801 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:15.061670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.062593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.063772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.064478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.346996 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:15.356256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8adeaf30-b020-4471-bf0f-f5d3ed5354e7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.307345 Jul 28 02:21:15.357193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 189/389] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:15 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:15.376846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:15.378162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:15.386252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.386957 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.387898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.388582 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.430877 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:15.431482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:15.438823 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.439251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.440251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.440741 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.746944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:15.757925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fb553f3c-e834-46a6-a7ad-d563c9fd1552 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.384848 Jul 28 02:21:15.758881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 201/390] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:15 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:15.781302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:15.793507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:15.795596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:15.797083 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4e10724-4379-4704-ba62-77de279a2a65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.370117 Jul 28 02:21:15.798097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 190/391] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:15 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:15.907799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:15.908921 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:15.915825 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.916440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.917380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.917950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.947539 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:15.948160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:15.956370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.957177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.959652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:15.960385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:15.999979 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:16.010351 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e4f90e78-0325-4ef9-9d06-c9ceed22aa62 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1462 microversion: 2.1 time: 0.107128 Jul 28 02:21:16.010975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 202/392] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:15 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:16.043895 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:16.055902 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-15086af3-ecf2-4c00-931e-39a5a3832dc1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1204 microversion: 2.1 time: 0.113059 Jul 28 02:21:16.056518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 191/393] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:15 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1204 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:16.379419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:16.379952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:16.390028 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.390884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.391807 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.392234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.522971 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-f1620ebd-5616-4749-a7cc-dca85c56c1ef req-7c8924b6-e24d-492d-a3f4-1b6a74f3dcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b5fd75-2db3-46be-8264-36011d52c8a9", "name": "network-vif-deleted", "tag": "6e132d86-41ff-4554-a4c5-042a10ca9f6c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:16.550077 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f1620ebd-5616-4749-a7cc-dca85c56c1ef req-7c8924b6-e24d-492d-a3f4-1b6a74f3dcb7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.551553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f1620ebd-5616-4749-a7cc-dca85c56c1ef req-7c8924b6-e24d-492d-a3f4-1b6a74f3dcb7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.585310 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-f1620ebd-5616-4749-a7cc-dca85c56c1ef req-7c8924b6-e24d-492d-a3f4-1b6a74f3dcb7 service nova] Creating event network-vif-deleted:6e132d86-41ff-4554-a4c5-042a10ca9f6c for instance 26b5fd75-2db3-46be-8264-36011d52c8a9 on hv-cinder-79987 Jul 28 02:21:16.605145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-f1620ebd-5616-4749-a7cc-dca85c56c1ef req-7c8924b6-e24d-492d-a3f4-1b6a74f3dcb7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087939 Jul 28 02:21:16.609098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 192/394] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:21:16.752576 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:16.761207 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c433c614-1e4b-454b-81c6-3d6d7c938ac6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.385804 Jul 28 02:21:16.761793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 203/395] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:16 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:16.782253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:16.782871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:16.789574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.790042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.790888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.791318 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.822922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:16.823813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:16.832306 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.832306 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:16.833030 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:16.833467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.084584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.097743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5cc48742-508c-4db7-aea0-9f10fb5697a9 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.320503 Jul 28 02:21:17.099204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 193/396] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:16 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:17.106016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:17.106918 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:17.118415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.120168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.121208 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.121644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.176989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.188127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.188858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.189609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lazy-loading 'fault' on Instance uuid 26b5fd75-2db3-46be-8264-36011d52c8a9 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:21:17.191453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.193449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.194974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4fee150d-17a8-40a1-a7e6-f00b7b083885 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.376465 Jul 28 02:21:17.196110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 204/397] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:16 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:17.201502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:17.202112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:17.209404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.210152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.211175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.211810 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.345228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb609c27e9e4069a079c7fe674bafa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a95d974bc1486c800b91945e600b7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.355503 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-19dae101-3ac6-4d7b-85fb-c088989f7f1f tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 200 len: 1304 microversion: 2.1 time: 0.254969 Jul 28 02:21:17.356202 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 194/398] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:17 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:17.362199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-aa73551e-4014-47c9-8257-ef30b06953f1 req-90bb2a6b-defd-4cbb-a169-31a1225092e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:17.374324 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-aa73551e-4014-47c9-8257-ef30b06953f1 req-90bb2a6b-defd-4cbb-a169-31a1225092e2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.375016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-aa73551e-4014-47c9-8257-ef30b06953f1 req-90bb2a6b-defd-4cbb-a169-31a1225092e2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.391982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-aa73551e-4014-47c9-8257-ef30b06953f1 req-90bb2a6b-defd-4cbb-a169-31a1225092e2 service nova] Creating event network-changed:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:21:17.397593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-aa73551e-4014-47c9-8257-ef30b06953f1 req-90bb2a6b-defd-4cbb-a169-31a1225092e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039444 Jul 28 02:21:17.399073 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 195/399] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:17.478363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.487829 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a392e68-d612-4fd6-8f30-3d9eb3ae12a6 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.290239 Jul 28 02:21:17.488987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 205/400] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:17 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:17.784438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:17.785252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:17.792437 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.792914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.793724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:17.794160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:17.945365 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:17.959442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-56e04638-724f-4f73-b2ce-516ef39c6f4a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.178263 Jul 28 02:21:17.960606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 196/401] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:17 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:18.123445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:18.124075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:18.130631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.131080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.131851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.132283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.223976 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:18.224581 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:18.231385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.232070 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.233381 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.233998 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.351177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:18.372685 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9a396c62-9aeb-4fad-ad28-5fd7c487fb7e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.252494 Jul 28 02:21:18.385260 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 206/402] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:18 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:18.385260 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1061aecc-6605-4249-b3ea-2688d51fcea4 req-d42d0ed8-8f21-4932-833a-dd1b14051a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "name": "network-vif-plugged", "status": "completed", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:18.398463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1061aecc-6605-4249-b3ea-2688d51fcea4 req-d42d0ed8-8f21-4932-833a-dd1b14051a37 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.399146 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1061aecc-6605-4249-b3ea-2688d51fcea4 req-d42d0ed8-8f21-4932-833a-dd1b14051a37 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.414606 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1061aecc-6605-4249-b3ea-2688d51fcea4 req-d42d0ed8-8f21-4932-833a-dd1b14051a37 service nova] Creating event network-vif-plugged:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:21:18.423961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1061aecc-6605-4249-b3ea-2688d51fcea4 req-d42d0ed8-8f21-4932-833a-dd1b14051a37 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044355 Jul 28 02:21:18.425248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 207/403] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:18.433308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:18.434377 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] [instance: 26b5fd75-2db3-46be-8264-36011d52c8a9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:18.434713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:18.445243 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.445497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:18.446011 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.447249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.447389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:18.447868 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.448962 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-290ade3a-0eb5-4c34-98b9-99ea974e184e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.229182 Jul 28 02:21:18.449597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 197/404] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:18 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:18.471188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] HTTP exception thrown: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Request method failure captured: Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 HTTP/1.1 Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fJMzWW2eFbOTJw-cFu8aucK-z2cFd5vKCFcTIlpvmwy9r88Fhh8ZVyvAGuDyDa71El6COnNiG6z7JrBLHsxomSNipk9R_HuyqG_WzxMrKsl81vw-8ERpsAAvcTz4loQHTlSV4wcDpueJQNlz6BJhdicjEol6n4cyAhYvZ1FvQdWMJU Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: c8a95d974bc1486c800b91945e600b7d Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-1562917228 Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:21:18.472998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c8a95d974bc1486c800b91945e600b7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-1562917228 Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: c8a95d974bc1486c800b91945e600b7d Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-1562917228 Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-1562917228-project Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 3fb609c27e9e4069a079c7fe674bafa0 Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-1562917228-project Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. Jul 28 02:21:18.474824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '26b5fd75-2db3-46be-8264-36011d52c8a9'} Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:21:18.475779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. Jul 28 02:21:18.477524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:18.479890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] Returning 404 to user: Instance 26b5fd75-2db3-46be-8264-36011d52c8a9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:21:18.479890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a7416857-fc26-4416-bd9e-88a6707bf810 tempest-VolumesActionsTest-1562917228 tempest-VolumesActionsTest-1562917228-project] 10.222.0.40 "GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9" status: 404 len: 111 microversion: 2.1 time: 0.049527 Jul 28 02:21:18.482603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 208/405] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:18 2022] GET /compute/v2.1/servers/26b5fd75-2db3-46be-8264-36011d52c8a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:21:18.510603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:18.511202 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:18.519454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.519903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.520658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:18.521304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:18.683472 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:18.693134 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aa3ee4ff-6f0c-45cd-9a88-c4f3dc63bdbf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.186509 Jul 28 02:21:18.693719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 198/406] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:18 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:18.984105 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:18.985433 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:19.002208 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.004350 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.005746 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.006835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.258844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.266905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e8015569-2900-4993-b7e1-4288a1e23b83 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.289557 Jul 28 02:21:19.267477 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 209/407] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:18 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:19.395989 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:19.396527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:19.404162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.404969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.405881 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.406329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.474914 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:19.475655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:19.483524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.484310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.485118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.485636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.580476 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.589136 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-73ea7e19-3fff-432e-ae96-a7aec8665192 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.197004 Jul 28 02:21:19.589719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 199/408] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:19 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:19.661258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.671379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.672973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.674154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-18c61fa3-1fb6-4d75-85d0-0bda81bd4332 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.203610 Jul 28 02:21:19.674734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 210/409] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:19 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:19.713451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:19.714057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:19.721608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.722109 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.722911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:19.723381 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:19.867807 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:19.876265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-58924a4d-322e-4698-979c-d0812243fbc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.166615 Jul 28 02:21:19.876842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 200/410] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:19 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:20.287948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:20.288565 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:20.294966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.295531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.296316 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.296758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.435060 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:20.439197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:20.443934 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0902780b-5ae9-4434-8c64-7028208a6c26 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.159757 Jul 28 02:21:20.444452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 211/411] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:20 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:20.609222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:20.613962 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:20.615226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:20.621747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.622200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.623899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.624373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.697728 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:20.698363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:20.705634 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.706093 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.706881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.707321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.790440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:20.798971 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d8d38aa6-a330-47c9-86f9-b195a0f21a10 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.191110 Jul 28 02:21:20.799558 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 201/412] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:20 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:20.858523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:20.867302 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:20.868846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:20.870072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-13920b5e-d529-4715-bed2-d361897a2104 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.176690 Jul 28 02:21:20.870632 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 212/413] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:20 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:20.896961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:20.897587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:20.903783 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.904387 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:20.905253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:20.905685 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.039843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:21.048851 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-139622b8-9239-4027-b222-f9e7cdbef602 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.155798 Jul 28 02:21:21.049454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 202/414] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:20 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:21.465287 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:21.465955 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:21.472619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.473097 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.474117 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.474542 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.614550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:21.622755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c42ca7c3-26bf-485d-b557-d6d0a0f548ea tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.161308 Jul 28 02:21:21.623323 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 213/415] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:21 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:21.821070 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:21.821610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:21.823497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:21.830356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.830800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.831588 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.832211 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.894530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:21.895123 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:21.902061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.902503 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:21.903276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:21.903759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.003080 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.014736 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dc8844e6-1ed9-4337-b9d4-66ff3f6ecab8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.196681 Jul 28 02:21:22.016199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 203/416] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:21 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:22.065871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.069672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:22.070288 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:22.075245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.077227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:22.077679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.077820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.078454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:22.078888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.079258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-30b87cae-716f-4dd8-9172-69a560308f9f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.188739 Jul 28 02:21:22.079898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 214/417] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:21 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:22.100139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:22.214690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.223148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63f84e55-fd7a-4ac0-beb3-58950a78117b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.157236 Jul 28 02:21:22.223978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 204/418] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:22 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:22.620163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c169788d-1247-42e0-9b14-dce3a604cfb0 req-cafd7b7f-6a8f-4fae-aaa1-aecfbc0b93fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e", "name": "network-vif-plugged", "status": "completed", "tag": "d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:22.630647 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c169788d-1247-42e0-9b14-dce3a604cfb0 req-cafd7b7f-6a8f-4fae-aaa1-aecfbc0b93fb service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:22.631160 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c169788d-1247-42e0-9b14-dce3a604cfb0 req-cafd7b7f-6a8f-4fae-aaa1-aecfbc0b93fb service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.643138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c169788d-1247-42e0-9b14-dce3a604cfb0 req-cafd7b7f-6a8f-4fae-aaa1-aecfbc0b93fb service nova] Creating event network-vif-plugged:d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df for instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e on hv-cinder-79987 Jul 28 02:21:22.644780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:22.645617 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:22.648814 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c169788d-1247-42e0-9b14-dce3a604cfb0 req-cafd7b7f-6a8f-4fae-aaa1-aecfbc0b93fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Jul 28 02:21:22.649802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 215/419] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:22.655733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:22.656191 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.657088 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:22.657525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:22.798222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:22.805850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-66b40da3-0c89-45ec-935f-960d67af0ed1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.165830 Jul 28 02:21:22.806541 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 205/420] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:22 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:23.040760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:23.041485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:23.048816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.049305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.050078 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.050507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.104809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:23.105454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:23.113250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.113964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.115648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.116262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.255808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:23.263687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b374e180-992b-4f5d-81c1-efa91b94635e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.227557 Jul 28 02:21:23.264344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 216/421] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:23 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:23.269469 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:23.270077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:23.276168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.276611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.277793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.278253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.289336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:23.302943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:23.304348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:23.305542 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a82fddf5-4ca8-4736-a301-4ce3d5991f4f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.205729 Jul 28 02:21:23.306127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 206/422] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:23 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:23.450267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:23.458636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df200910-0d69-476e-8192-b5b808eb894f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.192942 Jul 28 02:21:23.459233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 217/423] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:23 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:23.827484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:23.828296 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:23.835272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.836114 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:23.839760 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:23.840316 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.048055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.063171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7cf45f2a-4a3c-4f2f-96e6-24e044cd1313 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.239967 Jul 28 02:21:24.064419 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 207/424] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:23 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:24.286786 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:24.287622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:24.296452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.297007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.298107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.298643 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.332036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:24.332643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:24.343632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.344375 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.345342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.345972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.558691 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.572929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d533596d-7e81-423d-8e60-f73d8c84553a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.287973 Jul 28 02:21:24.589729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 218/425] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:24 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:24.605245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.612820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:24.614248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:24.621258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.624736 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.626318 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-26f9d9df-8654-4b22-8ed9-5d2e0834503c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1808 microversion: 2.20 time: 0.298118 Jul 28 02:21:24.628850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 208/426] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:24 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:21:24.639888 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.641057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.642660 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:24.643571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:24.841111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:24.851816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2a03457a-b2ab-4bd5-970c-35d9c7ebb9ef tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.260737 Jul 28 02:21:24.864905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 219/427] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:24 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:25.094765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:25.095374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:25.103505 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.104248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.105193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.105789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.309352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:25.319170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-033ce5bb-b13e-4a9b-977e-a9d2b080fb67 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.228832 Jul 28 02:21:25.320060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 209/428] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:25 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:25.601631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:25.602283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:25.610382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.611113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.611893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.612507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.651496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:25.652793 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:25.663852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.664666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.665731 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.666999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.840399 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:25.852961 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a7cca82-d7fc-440b-aca8-bb0444c01dde tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.255306 Jul 28 02:21:25.853993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 220/429] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:25 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:25.881289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:25.889471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:25.889471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:25.894828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:25.896713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:25.896858 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.897260 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.898042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:25.898550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:25.899190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8edb0633-8d33-4877-9488-3543fbbc10b4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1795 microversion: 2.20 time: 0.251971 Jul 28 02:21:25.900471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 210/430] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:21:25 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1795 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:21:26.058532 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:26.071453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8a933a9e-9b9a-49ed-80d0-75165503f8ca tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.193134 Jul 28 02:21:26.072246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 221/431] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:25 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:26.350882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:26.352092 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:26.363440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:26.365702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:26.368021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:26.373105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:26.553364 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:26.567384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c5a9c93-9270-47b7-ace1-04d230935aed tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1265 microversion: 2.1 time: 0.220537 Jul 28 02:21:26.582039 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 211/432] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:26 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:26.881005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:26.882298 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:26.890775 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:26.892785 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:26.893445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:26.894406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:26.895017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.064812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:27.074742 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0e355d98-4556-4a31-9ce2-29d06f049483 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.198238 Jul 28 02:21:27.076083 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 222/433] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:26 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:27.093992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:27.094603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:27.101224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.102086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.103172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.103610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.252292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:27.261577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-89e7c50e-8a13-4317-a76e-698ff53d98ee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.172860 Jul 28 02:21:27.262363 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 212/434] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:27 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:27.595070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:27.596241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:27.604755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.605633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.606424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.607843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.773380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:27.781557 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4a194109-ce28-4a18-a22c-7f1971eb2888 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1451 microversion: 2.1 time: 0.193671 Jul 28 02:21:27.796903 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 223/435] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:27 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:27.803673 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:27.804370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:27.811608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.812198 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.813418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:27.813889 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:27.869864 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:21:27.870455 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:21:27.978021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:27.986270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1d816c12-d8e9-4850-b2bb-751cc5520c5b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1451 microversion: 2.1 time: 0.186143 Jul 28 02:21:27.987037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 213/436] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:27 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1451 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:28.100590 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:28.103523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:28.125288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.125658 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.126452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.126963 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.288250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:28.289950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:28.314428 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.315166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.316410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.320018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.677396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:28.685761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-301475a8-71df-4482-9790-1619252bbd1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.589841 Jul 28 02:21:28.703797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 224/437] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:28 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:28.708936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:28.709413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:28.725872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.726331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.727131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.727620 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.780384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a5b57f7-550d-4567-bf2e-a7015133a6f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/ips" status: 200 len: 150 microversion: 2.1 time: 0.074023 Jul 28 02:21:28.786845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 225/438] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:21:28 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:28.792165 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5841f91a-ce79-43a5-97b6-ff41314425a0"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:28.795412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:28.801875 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.802333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.803120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.803561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.908946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:28.918450 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-142ffeba-773f-4137-b463-f3c12457fade tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.635495 Jul 28 02:21:28.920939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 214/439] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:28 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:28.929991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/os-volume_attachments HTTP/1.1 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 74 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:21:28.932194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {"volumeAttachment": {"volumeId": "5841f91a-ce79-43a5-97b6-ff41314425a0"}} Jul 28 02:21:28.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'server_id': '606c5aa8-a5d8-4890-b67f-5be4476fea19', 'body': {'volumeAttachment': {'volumeId': '5841f91a-ce79-43a5-97b6-ff41314425a0'}}} Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:28.934559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:28.935816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:28.937199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:28.937199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:21:28.937199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:21:28.937199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c Jul 28 02:21:28.937199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:28.941396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 400 to user: Invalid volume: volume 5841f91a-ce79-43a5-97b6-ff41314425a0 is already attached to instances: 4d26f3b8-4d46-47fe-84fe-f242e97a778c {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:21:28.944013 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7a1de671-69e4-4b58-8bf4-194de378ce29 req-5439e5ca-8a16-45b1-ba1e-0cefcd82125f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "name": "network-vif-plugged", "status": "completed", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:28.945256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7333c10d-d388-4015-abf9-0fc7e8be2896 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157201 Jul 28 02:21:28.946178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 226/440] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:21:28 2022] POST /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:21:28.956944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:28.960006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:28.978924 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7a1de671-69e4-4b58-8bf4-194de378ce29 req-5439e5ca-8a16-45b1-ba1e-0cefcd82125f service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.980509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7a1de671-69e4-4b58-8bf4-194de378ce29 req-5439e5ca-8a16-45b1-ba1e-0cefcd82125f service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.983020 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.983898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:28.988783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:28.990020 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.004920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7a1de671-69e4-4b58-8bf4-194de378ce29 req-5439e5ca-8a16-45b1-ba1e-0cefcd82125f service nova] Creating event network-vif-plugged:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:21:29.018246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7a1de671-69e4-4b58-8bf4-194de378ce29 req-5439e5ca-8a16-45b1-ba1e-0cefcd82125f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095844 Jul 28 02:21:29.019315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 215/441] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:29.037168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:21:29.100900 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:29.142686 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-39072cb2-d824-4b90-b777-48dee6a6e9fe tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 204 len: 0 microversion: 2.1 time: 0.191558 Jul 28 02:21:29.143910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 227/442] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:21:28 2022] DELETE /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:21:29.163190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:29.164071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:29.181648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.187755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.188840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.190704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.397726 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:29.411838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1055efc7-90da-4a18-b457-e9aa941fd447 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1682 microversion: 2.1 time: 0.255917 Jul 28 02:21:29.427585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 216/443] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:29 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1682 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:29.718040 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:29.719884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:29.755021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.756442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.758941 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.759504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.948267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:29.948724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:29.968280 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.969238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.974888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:29.975591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:29.999579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:30.015420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc93eb6a-abee-4637-a657-141320c376e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.305648 Jul 28 02:21:30.042255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 228/444] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:29 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:30.221757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:30.232504 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-62956bdd-fd6a-4b82-aca8-cd153bf3bd5e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.290275 Jul 28 02:21:30.234025 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 217/445] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:29 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:30.441042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:30.441732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:30.451809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:30.452261 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:30.453118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:30.453570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:30.663731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:30.671546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2c4ba3f4-3b57-4daa-80f8-95dc1550066f req-47fe229d-f8d3-429e-832a-6e7f5b861b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e", "tag": "d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:30.673894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-13eeeae6-5176-438a-a52c-7014262b63fd tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1682 microversion: 2.1 time: 0.237587 Jul 28 02:21:30.674496 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 229/446] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:30 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:30.684751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2c4ba3f4-3b57-4daa-80f8-95dc1550066f req-47fe229d-f8d3-429e-832a-6e7f5b861b79 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:30.684751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2c4ba3f4-3b57-4daa-80f8-95dc1550066f req-47fe229d-f8d3-429e-832a-6e7f5b861b79 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:30.696672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2c4ba3f4-3b57-4daa-80f8-95dc1550066f req-47fe229d-f8d3-429e-832a-6e7f5b861b79 service nova] Creating event network-changed:d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df for instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e on hv-cinder-79987 Jul 28 02:21:30.702630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2c4ba3f4-3b57-4daa-80f8-95dc1550066f req-47fe229d-f8d3-429e-832a-6e7f5b861b79 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035306 Jul 28 02:21:30.703344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 218/447] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:31.050006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:31.051409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:31.069186 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.069823 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.070623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.072087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.257901 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:31.258621 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:31.266870 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.267693 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.268994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.269875 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.623318 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:31.635731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-94bcb069-fb09-46ae-8865-eb3187752f31 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.592193 Jul 28 02:21:31.649985 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 230/448] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:31 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:31.701210 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:31.702105 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:31.714947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.725705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.726549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:31.726986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:31.803792 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:31.835127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6b9ed6ca-7817-4961-8dc4-9817a74c53ae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.584872 Jul 28 02:21:31.836047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 219/449] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:31 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:32.051869 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:32.061369 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-468199f4-e7f5-4631-9b40-536898a81fed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1682 microversion: 2.1 time: 0.365162 Jul 28 02:21:32.062256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 231/450] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:31 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1682 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:32.663037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:32.664986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:32.677545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:32.678655 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:32.680420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:32.681267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:32.858429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:32.859151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:32.867741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:32.868471 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:32.869610 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:32.870362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:32.893529 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:32.905222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8bbf9da2-e49c-420a-9d10-a017b2a46be3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.247503 Jul 28 02:21:32.913497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 220/451] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:32 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:33.101891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:33.104099 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:33.105556 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:33.116808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:33.117489 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:33.118879 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37401ef7-5d86-4983-a25f-5c03e58c62af tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1259 microversion: 2.1 time: 0.265194 Jul 28 02:21:33.120337 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 232/452] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:32 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:33.121407 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:33.123075 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:33.210385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-2fd54484-8e0e-4839-9e47-ca7f9e9dc207 req-c45f7ecf-8e9b-40c8-be8e-c56875907faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606c5aa8-a5d8-4890-b67f-5be4476fea19", "name": "network-vif-deleted", "tag": "60dcd1ef-cfe6-44be-bd4d-be1a1761d28d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:33.241436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-2fd54484-8e0e-4839-9e47-ca7f9e9dc207 req-c45f7ecf-8e9b-40c8-be8e-c56875907faf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:33.246463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-2fd54484-8e0e-4839-9e47-ca7f9e9dc207 req-c45f7ecf-8e9b-40c8-be8e-c56875907faf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:33.271779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-2fd54484-8e0e-4839-9e47-ca7f9e9dc207 req-c45f7ecf-8e9b-40c8-be8e-c56875907faf service nova] Creating event network-vif-deleted:60dcd1ef-cfe6-44be-bd4d-be1a1761d28d for instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 on hv-cinder-79987 Jul 28 02:21:33.282694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-2fd54484-8e0e-4839-9e47-ca7f9e9dc207 req-c45f7ecf-8e9b-40c8-be8e-c56875907faf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083874 Jul 28 02:21:33.283897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 233/453] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:33.284177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:33.322670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-393a288b-1c60-4813-83b5-b79c436f38c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1615 microversion: 2.1 time: 0.221592 Jul 28 02:21:33.327449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 221/454] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:33 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1615 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:33.932308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:33.933622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:33.942376 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:33.943118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:33.944050 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:33.944638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.150412 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:34.151015 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:34.176096 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.181821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.186942 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.189392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:34.203846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0e0b33e3-a707-424c-b910-2d4e488de410 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.276151 Jul 28 02:21:34.213858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.222701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 234/455] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:33 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:34.348691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:34.370630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:34.377089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:34.397055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.414300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.415566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.416181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.520121 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.520570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.521411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'fault' on Instance uuid 606c5aa8-a5d8-4890-b67f-5be4476fea19 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:21:34.605747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:34.625909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37eacdc6-e7f7-4f52-ac8c-1cf89d9b7cc0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 200 len: 1332 microversion: 2.1 time: 0.281967 Jul 28 02:21:34.626858 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 235/456] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:34 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 1332 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:34.645345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:34.659708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3ffb18d5-5fb1-4e33-b046-daa7e82fc3e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1442 microversion: 2.1 time: 0.517741 Jul 28 02:21:34.673564 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 222/457] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:34 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1442 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:34.687649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:34.688257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:34.708361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.708802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:34.709917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:34.710511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.057485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:35.069920 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4b256d12-e09e-4429-bf99-baad89bef904 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1442 microversion: 2.1 time: 0.388898 Jul 28 02:21:35.085342 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 236/458] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:34 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1442 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:35.236820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:35.237603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:35.247936 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.248990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.255893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.258619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.560679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:35.574769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5091e307-cf07-4f05-b285-c61043dcc76a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1502 microversion: 2.1 time: 0.344141 Jul 28 02:21:35.585037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 223/459] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:35 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:35.610605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e157a6cb-dd51-4496-84e8-d4cdc9306024"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:35.624848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:35.656467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.660252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:35.661480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.663559 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.664187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.665906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:35.687518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.688232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.696958 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.697952 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.730812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] HTTP exception thrown: Cannot 'attach_volume' instance 57fb7f5a-d860-4022-a284-a364155ba3ba while it is in vm_state rescued Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Request method failure captured: Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/os-volume_attachments HTTP/1.1 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 74 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fI4YAiSBti0RGiamXJLr054Mccmo8rvde74uwjbQj0UtXB7BOuTcPsV4Bb9rWvj09egroTr6tu_RM6MWvtSlPWQP5ZtWXS8wTkrpo5ANOwpnyuyMXk7bGYvEqmPWkn6wCUkTS-5qVTh8T8iTjyMtRSbIVt0jdrHDfkdolNqTT8IX30 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:21:35.735080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5157a5b7f25482980f925175adf2090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5157a5b7f25482980f925175adf2090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 50a2f75083ec40f3a6254c25b57862ae Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {"volumeAttachment": {"volumeId": "e157a6cb-dd51-4496-84e8-d4cdc9306024"}} Jul 28 02:21:35.737381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Cannot 'attach_volume' instance 57fb7f5a-d860-4022-a284-a364155ba3ba while it is in vm_state rescued Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'server_id': '57fb7f5a-d860-4022-a284-a364155ba3ba', 'body': {'volumeAttachment': {'volumeId': 'e157a6cb-dd51-4496-84e8-d4cdc9306024'}}} Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:21:35.738649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 57fb7f5a-d860-4022-a284-a364155ba3ba while it is in vm_state rescued Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:35.742384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:35.746154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:21:35.746154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:21:35.746154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 57fb7f5a-d860-4022-a284-a364155ba3ba while it is in vm_state rescued Jul 28 02:21:35.746154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 HTTP/1.1 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:21:35.746869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:21:35.752758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '606c5aa8-a5d8-4890-b67f-5be4476fea19'} Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:21:35.756385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:21:35.759057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:21:35.762287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:21:35.762287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-474d4692-f3c8-40ce-b338-0167a47a6554 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 404 len: 111 microversion: 2.1 time: 0.094928 Jul 28 02:21:35.762287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 224/460] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:35 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:21:35.762287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-36811f7f-114f-439f-9c30-c5afc70caf6f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '.version_select at 0x7efc52ee7c10>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:35.762971 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Returning 409 to user: Cannot 'attach_volume' instance 57fb7f5a-d860-4022-a284-a364155ba3ba while it is in vm_state rescued {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:21:35.762971 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b517278-b306-4514-9ec2-f8a45b2d2671 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.157997 Jul 28 02:21:35.767494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 237/461] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:21:35 2022] POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/os-volume_attachments => generated 152 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 02:21:35.776386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:35.780532 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:35.795379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-36811f7f-114f-439f-9c30-c5afc70caf6f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314819171" status: 202 len: 0 microversion: 2.1 time: 0.043229 Jul 28 02:21:35.797280 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.797832 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.798635 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.800647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 225/462] 10.222.0.40 () {58 vars in 1221 bytes} [Thu Jul 28 02:21:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1314819171 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:35.803388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.958611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a107b53f-528a-49dc-bc80-9220e5d95e26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/action" status: 202 len: 0 microversion: 2.1 time: 0.187043 Jul 28 02:21:35.960838 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 238/463] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:21:35 2022] POST /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:35.970719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:35.975139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:35.987113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.987851 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:35.989134 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:35.989739 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:36.412905 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:36.427182 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-243edbbb-df74-4c7b-8268-2ae567b50c28 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1510 microversion: 2.1 time: 0.461600 Jul 28 02:21:36.427769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 226/464] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:35 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:37.017372 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:37.018492 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:37.025901 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.026381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.027481 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.027922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.196947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'services' on Instance uuid 4d26f3b8-4d46-47fe-84fe-f242e97a778c {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:21:37.382118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca365f4f-bd1a-407a-aa49-48d14b984035 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments/5841f91a-ce79-43a5-97b6-ff41314425a0" status: 202 len: 0 microversion: 2.1 time: 0.369054 Jul 28 02:21:37.383410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 239/465] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:21:37 2022] DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments/5841f91a-ce79-43a5-97b6-ff41314425a0 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:37.396147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:37.401894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:37.414578 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:37.430821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.432949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.434070 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.437184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.454305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:37.455321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:37.472550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.474538 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.476276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:37.477301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:37.478505 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bb304c15-196e-4177-b5e4-b81064610de2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090928 Jul 28 02:21:37.479635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 227/466] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:21:37 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:37.656660 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:37.667472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-11980315-532f-405e-86bc-c9e2a6ce2a72 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1510 microversion: 2.1 time: 0.218992 Jul 28 02:21:37.683085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 240/467] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:37 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:38.498378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:38.504687 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:38.524370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:38.527184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:38.530992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:38.531759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:38.541569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-586441cf-dc62-4e5b-bff3-6091372aef30 req-5a7230aa-dd27-4ccc-b9f8-014d68feab55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:38.553924 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-586441cf-dc62-4e5b-bff3-6091372aef30 req-5a7230aa-dd27-4ccc-b9f8-014d68feab55 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:38.554367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-586441cf-dc62-4e5b-bff3-6091372aef30 req-5a7230aa-dd27-4ccc-b9f8-014d68feab55 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:38.568250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-586441cf-dc62-4e5b-bff3-6091372aef30 req-5a7230aa-dd27-4ccc-b9f8-014d68feab55 service nova] Creating event network-changed:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:21:38.580923 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8b3ada15-4178-4645-8eee-404f7f519a80 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092483 Jul 28 02:21:38.581982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 228/468] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:21:38 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:38.591142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-586441cf-dc62-4e5b-bff3-6091372aef30 req-5a7230aa-dd27-4ccc-b9f8-014d68feab55 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051942 Jul 28 02:21:38.593368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 241/469] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:21:38.689675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:38.690388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:38.696954 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:38.697415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:38.698211 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:38.698654 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:38.849614 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:38.858117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7bcf1cea-5a0d-4ada-aab2-08181e2165d0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1510 microversion: 2.1 time: 0.172969 Jul 28 02:21:38.858710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 229/470] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:38 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:39.599342 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:39.604747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:39.625858 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:39.628378 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:39.632857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:39.635030 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:39.696441 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a1e58e6f-6a07-4295-82ae-98b989725dc3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105301 Jul 28 02:21:39.697499 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 242/471] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:21:39 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:21:39.879305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:39.880074 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:39.890607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:39.891384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:39.892368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:39.892982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:40.110196 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:40.119791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac436b9f-6467-4f8f-ada4-8e6e833c471a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1510 microversion: 2.1 time: 0.244197 Jul 28 02:21:40.120549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 230/472] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:39 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:40.712984 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:40.716736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:40.742051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:40.745326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:40.749510 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:40.764423 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:40.839532 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-99e36565-118a-4d1b-9d80-dd10f2845096 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132461 Jul 28 02:21:40.840863 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 243/473] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:21:40 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 02:21:40.966288 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:40.967306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:40.987474 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.001409 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.002590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.003221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.065433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:21:41.155783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:41.157368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:41.194464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.195464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.199329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.201695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.213338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:41.220146 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6d6b026-043b-45a4-b99f-cccbcbf56b29 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 204 len: 0 microversion: 2.1 time: 0.260198 Jul 28 02:21:41.222456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 231/474] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:21:40 2022] DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:21:41.237362 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:41.238355 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:41.244722 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.245473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.246465 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:41.247711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:41.462581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:41.478322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d67fed48-9a13-4b55-a164-cd02ae89fa4f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1516 microversion: 2.1 time: 0.337124 Jul 28 02:21:41.479862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 244/475] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:41 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:41.542629 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:41.557770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-574cfab9-6897-4bcd-addb-e8e4312ea19a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1682 microversion: 2.1 time: 0.324095 Jul 28 02:21:41.559150 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 232/476] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:41 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1682 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:42.587045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:42.588412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:42.596063 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:42.596840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:42.597686 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:42.598130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:42.783820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:42.798457 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7e3b837d-1964-4418-9d97-dd6eccf8d76b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1682 microversion: 2.1 time: 0.215232 Jul 28 02:21:42.799046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 245/477] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:42 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:43.039610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3bed4618-d851-41f0-b1fb-65ec45581243 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: .version_select at 0x7efc52f635e0>, body: {"keypair": {"name": "tempest-keypair-460012602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtwcPXgfF9l4IKEVm+Btk4QN88wCt9w4ksSHrnr3MVkOr0hwv2h1VdCRyudle1Axl2ytbfHmZoW9WCbnFt4AtRI7gD4OrF3aR1ja4txNqAU4cZoqZAkoa4erT3W0Z9Qyw=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:43.056697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-3bed4618-d851-41f0-b1fb-65ec45581243 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for project b5157a5b7f25482980f925175adf2090. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:21:43.062053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-3bed4618-d851-41f0-b1fb-65ec45581243 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for user 50a2f75083ec40f3a6254c25b57862ae and project b5157a5b7f25482980f925175adf2090. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:21:43.086396 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3bed4618-d851-41f0-b1fb-65ec45581243 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050753 Jul 28 02:21:43.086999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 233/478] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:21:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:43.821762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:43.822588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:43.830202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:43.831599 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:43.832467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:43.832905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:44.049800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:44.064371 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c2086f06-919d-4536-aa80-43f47c6ccb2e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1682 microversion: 2.1 time: 0.246957 Jul 28 02:21:44.065724 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 246/479] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:43 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:44.626127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7b0b9338-b19c-46ef-a23f-6265e00e4f49 req-99a2131e-a4f1-4e0e-a048-f46854a35075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d26f3b8-4d46-47fe-84fe-f242e97a778c", "name": "network-vif-deleted", "tag": "f6815afe-e104-4782-8f6b-4017625ff4b9"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:44.670184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7b0b9338-b19c-46ef-a23f-6265e00e4f49 req-99a2131e-a4f1-4e0e-a048-f46854a35075 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:44.672047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7b0b9338-b19c-46ef-a23f-6265e00e4f49 req-99a2131e-a4f1-4e0e-a048-f46854a35075 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:44.716755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7b0b9338-b19c-46ef-a23f-6265e00e4f49 req-99a2131e-a4f1-4e0e-a048-f46854a35075 service nova] Creating event network-vif-deleted:f6815afe-e104-4782-8f6b-4017625ff4b9 for instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c on hv-cinder-79987 Jul 28 02:21:44.727142 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7b0b9338-b19c-46ef-a23f-6265e00e4f49 req-99a2131e-a4f1-4e0e-a048-f46854a35075 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107006 Jul 28 02:21:44.732820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 234/480] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:21:44.851754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-191016127", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "409dbfc5-7fa3-448b-9a8d-151bbb9f6be9"}], "security_groups": [{"name": "tempest-securitygroup--1642783550"}], "key_name": "tempest-keypair-460012602", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:44.979227 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] validate_networks() for [('409dbfc5-7fa3-448b-9a8d-151bbb9f6be9', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:21:45.092255 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:45.092999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:45.100244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:45.100906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:45.101838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:45.102418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:45.183589 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:45.184481 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:45.185355 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'fault' on Instance uuid 4d26f3b8-4d46-47fe-84fe-f242e97a778c {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:21:45.253129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:45.262017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f35903b5-0d97-4056-ba15-5893173b54ad tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 200 len: 1331 microversion: 2.1 time: 0.175936 Jul 28 02:21:45.265506 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 235/481] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:45 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:45.502365 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:21:45.502628 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:21:45.503103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:21:45.503526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:21:45.503928 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:21:45.514843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:45.515324 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:45.516128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:45.516568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:45.540944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:21:45.547432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Getting quotas for user 50a2f75083ec40f3a6254c25b57862ae and project b5157a5b7f25482980f925175adf2090. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:21:45.563664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:21:45.566291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:21:45.616400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7fbc9998-79e2-49cc-8036-0c04ae73b504 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.779206 Jul 28 02:21:45.617106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 247/482] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:21:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:21:45.629538 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a080c7ab-17e9-402d-97d3-8a161737ba41 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:45.630157 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a080c7ab-17e9-402d-97d3-8a161737ba41 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:45.687376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a080c7ab-17e9-402d-97d3-8a161737ba41 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:45.697250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a080c7ab-17e9-402d-97d3-8a161737ba41 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1244 microversion: 2.1 time: 0.071548 Jul 28 02:21:45.697842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 236/483] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:45 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:46.292259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:46.293070 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:46.300046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.300766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.301584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.302019 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.316923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c HTTP/1.1 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:21:46.318884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:21:46.320401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '4d26f3b8-4d46-47fe-84fe-f242e97a778c'} Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:21:46.321321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:21:46.322754 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:21:46.323951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:21:46.323951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f06ed6ef-03a1-44e7-ac1e-383d55d6a9f5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 404 len: 111 microversion: 2.1 time: 0.033471 Jul 28 02:21:46.323951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 248/484] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:46 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:21:46.331905 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-60ec9d9e-f923-437c-af76-e4ea154efe3c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '.version_select at 0x7efc52f02ca0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:46.354903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-60ec9d9e-f923-437c-af76-e4ea154efe3c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525184663" status: 202 len: 0 microversion: 2.1 time: 0.026872 Jul 28 02:21:46.355497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 237/485] 10.222.0.40 () {58 vars in 1218 bytes} [Thu Jul 28 02:21:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525184663 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:46.675639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:46.679435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:46.687533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.687991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.688783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.689241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.718643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:46.719373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:46.726899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.727675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.728754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.729310 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.806994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c785aeab-e323-4926-bb5f-48f720e4b9e5 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.135284 Jul 28 02:21:46.811385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 249/486] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:21:46 2022] POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:21:46.828163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:46.829388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:46.842954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.843501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.844321 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:46.844761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:46.858266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:46.865886 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-522b18ed-ce74-4285-88e7-29c1a2fcc72a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1304 microversion: 2.1 time: 0.151411 Jul 28 02:21:46.877948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 238/487] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:46 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:47.254254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:47.268913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d7a4e3a-1c05-4d50-9628-38eadbd04c12 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1750 microversion: 2.1 time: 0.452489 Jul 28 02:21:47.270419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 250/488] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:46 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1750 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:47.582141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa90f014-a5b7-4c81-8462-f2c5064d1575 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: .version_select at 0x7efc52f6e790>, body: {"keypair": {"name": "tempest-keypair-136208811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX5Hj8G2Ong/6pMjRJv0Kxh0ooQL3Oc14cEXP1WmyQNSBHCv2JsjMk9POq4kgXtrcSwsR6bkdHJZMz7bTgH9bTUJuRtVYAy9MxR0ZSu1qo3jeFCojJ0S2oqNSqE71wBhQ=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:47.612117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-fa90f014-a5b7-4c81-8462-f2c5064d1575 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:21:47.619308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-fa90f014-a5b7-4c81-8462-f2c5064d1575 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:21:47.654498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa90f014-a5b7-4c81-8462-f2c5064d1575 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078379 Jul 28 02:21:47.656058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 239/489] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:21:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:21:47.898935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:47.901507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:47.910629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:47.911162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:47.912171 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:47.912669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:48.178473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:48.207164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a993c0f1-4126-4462-971d-2fa876b8b692 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.307972 Jul 28 02:21:48.213338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 251/490] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:47 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:48.297978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:48.299413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:48.306898 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:48.307997 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:48.311777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:48.312546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:48.862508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:48.870791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c84abe18-08ee-4500-b597-efc48f7f5c0a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.578684 Jul 28 02:21:48.871597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 240/491] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:48 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:49.234081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ec518daf-a644-4946-bcef-caeb99c2f72d req-0da5b685-1efa-42a2-9a57-171a4c2769d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:49.246710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:49.247669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:49.254152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ec518daf-a644-4946-bcef-caeb99c2f72d req-0da5b685-1efa-42a2-9a57-171a4c2769d2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:49.254958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ec518daf-a644-4946-bcef-caeb99c2f72d req-0da5b685-1efa-42a2-9a57-171a4c2769d2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:49.269206 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:49.270154 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:49.271251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:49.271694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:49.273008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ec518daf-a644-4946-bcef-caeb99c2f72d req-0da5b685-1efa-42a2-9a57-171a4c2769d2 service nova] Creating event network-changed:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:21:49.283458 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ec518daf-a644-4946-bcef-caeb99c2f72d req-0da5b685-1efa-42a2-9a57-171a4c2769d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055311 Jul 28 02:21:49.284594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 252/492] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:49.536351 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:49.545328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2cb4c9d-ccd1-436f-880f-5bd0a48eb84c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.307277 Jul 28 02:21:49.546120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 241/493] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:49 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:49.896675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:49.897848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:49.906156 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:49.906612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:49.907440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:49.907909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:49.964392 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1902383268", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda255f1-8497-41f0-9d65-8f281bd7eb0d"}], "security_groups": [{"name": "tempest-securitygroup--709350816"}], "key_name": "tempest-keypair-136208811", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:50.087583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:50.098452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-798c151b-4538-4eae-bb70-ff3d8fd813ee tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.208316 Jul 28 02:21:50.099028 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 253/494] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:49 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:50.099243 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] validate_networks() for [('bda255f1-8497-41f0-9d65-8f281bd7eb0d', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:21:50.481550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:21:50.481964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:21:50.482428 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:21:50.482830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:21:50.483231 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:21:50.491990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:50.492429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:50.493251 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:50.493679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:50.510515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:21:50.515495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:21:50.526256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:21:50.529347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:21:50.565845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:50.566451 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:50.573035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:50.573413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2272db7f-624b-4b1c-a994-72d9f8458bdc tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613462 Jul 28 02:21:50.573856 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:50.574305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:50.575057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 242/495] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:21:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 02:21:50.575193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:50.586846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a6e8c7d-8a72-495a-982a-31347011aaff tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:50.587458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7a6e8c7d-8a72-495a-982a-31347011aaff tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:50.677701 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7a6e8c7d-8a72-495a-982a-31347011aaff tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:50.693041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a6e8c7d-8a72-495a-982a-31347011aaff tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1241 microversion: 2.1 time: 0.109906 Jul 28 02:21:50.694432 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 243/496] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:50 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:50.738690 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:50.747430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b0ea6cf4-f0cb-4a8c-9ee8-7e85ef39ff1e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.185190 Jul 28 02:21:50.748087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 254/497] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:50 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:51.122040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:51.122657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:51.129302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.129747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.130509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.130941 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.299235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:51.308183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f7dc49bc-1e9f-44d5-b2a9-213ac02cf62b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.190861 Jul 28 02:21:51.308832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 244/498] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:51 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:51.722154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:51.724486 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:51.736582 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.737500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.738761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.739532 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.770414 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:51.771818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:51.781988 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.788838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.789777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:51.790299 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:51.800286 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:51.871300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:51.886179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-248122dd-cd6c-4b9a-afac-bfa5edce9403 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1301 microversion: 2.1 time: 0.171677 Jul 28 02:21:51.888568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 255/499] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:51 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:51.993899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:52.003227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a13eac68-9594-4f08-b6fd-d9758bff151c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.238558 Jul 28 02:21:52.003809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 245/500] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:51 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:52.331215 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:52.332091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:52.339278 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:52.339818 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:52.340933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:52.341613 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:52.504052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:52.512177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bd734e52-3e7e-4e41-b6eb-8b31aab3c352 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.185802 Jul 28 02:21:52.512995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 256/501] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:52 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:52.909283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:52.910526 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:52.917054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:52.917513 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:52.919436 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:52.919961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.025381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:53.026068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:53.036311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:53.036771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.037596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:53.038034 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.070097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:53.078217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4191d64b-372e-45b8-9401-70f2ced5bbe5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.172778 Jul 28 02:21:53.079047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 246/502] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:52 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:53.208726 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:53.218826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-47ee0e0c-4303-45ea-80a7-2cda2a644250 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.197651 Jul 28 02:21:53.219418 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 257/503] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:53 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:53.347429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-1119526b-ebb6-4501-8758-34d721287b1b req-62acaead-c224-4d3a-88d8-3ad3384a8ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6", "tag": "694278ed-c102-42be-8044-5a9265e3dcc1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:53.359030 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1119526b-ebb6-4501-8758-34d721287b1b req-62acaead-c224-4d3a-88d8-3ad3384a8ed8 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:53.359768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1119526b-ebb6-4501-8758-34d721287b1b req-62acaead-c224-4d3a-88d8-3ad3384a8ed8 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.377120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-1119526b-ebb6-4501-8758-34d721287b1b req-62acaead-c224-4d3a-88d8-3ad3384a8ed8 service nova] Creating event network-changed:694278ed-c102-42be-8044-5a9265e3dcc1 for instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 on hv-cinder-79987 Jul 28 02:21:53.382194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-1119526b-ebb6-4501-8758-34d721287b1b req-62acaead-c224-4d3a-88d8-3ad3384a8ed8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038649 Jul 28 02:21:53.385986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 247/504] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:53.533895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:53.534514 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:53.540539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:53.541021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.541786 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:53.542224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:53.691008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:53.699188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8647ec8f-a8d7-41fb-a2ef-7024ea44e5f6 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.169263 Jul 28 02:21:53.699792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 258/505] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:53 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:54.100866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:54.101487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:54.108017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.108461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.109248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.109680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.240926 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:54.241826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:54.250113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.250399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:54.250565 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.251340 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.251813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.258053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c2d625f-4418-4ffa-94c2-bbb7d89441be tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.162109 Jul 28 02:21:54.258622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 248/506] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:54 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:54.385423 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:54.393493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce8f08ce-1912-4686-b732-b899a3103314 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.156461 Jul 28 02:21:54.394067 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 259/507] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:54 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:54.720291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:54.720915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:54.727526 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.727973 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.728745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.729350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.890679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:54.898969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-df66ac36-93f7-41e5-ae61-f211e4843dcd tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.182554 Jul 28 02:21:54.899469 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 249/508] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:54 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:54.960978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-326663d4-aa97-45a8-a955-23295a837920 req-d10a3c5d-ba65-4f25-9e4c-4ec442871c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "name": "network-vif-plugged", "status": "completed", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:54.967237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:54.971209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-326663d4-aa97-45a8-a955-23295a837920 req-d10a3c5d-ba65-4f25-9e4c-4ec442871c1c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:54.971652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-326663d4-aa97-45a8-a955-23295a837920 req-d10a3c5d-ba65-4f25-9e4c-4ec442871c1c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:54.984987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-326663d4-aa97-45a8-a955-23295a837920 req-d10a3c5d-ba65-4f25-9e4c-4ec442871c1c service nova] Creating event network-vif-plugged:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:21:54.989893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-326663d4-aa97-45a8-a955-23295a837920 req-d10a3c5d-ba65-4f25-9e4c-4ec442871c1c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032561 Jul 28 02:21:54.990483 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 260/509] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:55.283616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:55.284667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:55.297447 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.298444 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:55.299677 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.300410 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:55.415788 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:55.417105 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:55.424515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.425012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:55.425927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.426573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:55.449949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:55.458177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3dd3eef4-1247-4c0a-abeb-e84ae7ef797e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.182392 Jul 28 02:21:55.458755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 250/510] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:55 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:55.524013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:55.557704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:55.579549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:55.587010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-adef06a8-6ab6-4dcb-8316-1e4916093c46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.176592 Jul 28 02:21:55.587566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 261/511] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:55 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:55.924049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:55.925234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:55.931427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.931873 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:55.932836 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:55.933276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:56.090587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:56.098981 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06f39930-8e8d-417b-8e50-d8d2aea58828 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.179194 Jul 28 02:21:56.099556 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 251/512] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:55 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:56.482404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:56.483009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:56.489453 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:56.489893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:56.490646 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:56.491073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:56.510465 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:56.609442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:56.610689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:56.614283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:21:56.618487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:56.618862 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:56.620024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:56.620210 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:56.637681 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:56.645395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d7253bab-113e-4a2f-9621-744b1907c841 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.169309 Jul 28 02:21:56.645969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 262/513] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:56 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:56.765108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:56.772502 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cd8f3bae-6789-4712-a11c-733b61794a3e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1370 microversion: 2.1 time: 0.167775 Jul 28 02:21:56.773168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 252/514] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:56 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:21:57.122429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:57.122958 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:57.129181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.129632 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.130428 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.130891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.278212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:57.287013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cb3b9dea-b560-4bca-959d-adbfe6ecfe4a tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.168669 Jul 28 02:21:57.287324 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 263/515] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:57 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:57.667646 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:57.668954 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:57.675595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.676046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.676806 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.677268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.794044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:57.794629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:57.801171 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.801692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.802525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.803026 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.815985 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:57.823414 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-37b2b7d9-8628-4109-94da-99d81165cbc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.159598 Jul 28 02:21:57.823977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 253/516] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:57 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:57.938262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:57.945801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e524cb16-326a-445c-a5a6-82e66e1c2b97 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1565 microversion: 2.1 time: 0.156334 Jul 28 02:21:57.946371 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 264/517] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:57 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:57.967341 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:57.967836 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:57.974173 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.974623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:57.975386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:57.975827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.053892 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c96f8b9-5668-47c7-ad05-39c2646529e2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091165 Jul 28 02:21:58.054482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 254/518] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:21:57 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:58.307762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:58.309053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:58.315192 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:58.315635 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.316396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:58.316824 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.601020 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:58.609891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e445f1be-3f7b-42c8-845b-8275fa9e55af tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.305980 Jul 28 02:21:58.610478 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 265/519] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:58 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:58.847590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:58.848725 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:58.854966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:58.857040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.858156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:58.858903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.873116 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-cc9163c4-7c4a-44c6-866b-3e15208594a5 req-b5bd9f99-a773-457f-8722-fdd8ca42f09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6", "name": "network-vif-plugged", "status": "completed", "tag": "694278ed-c102-42be-8044-5a9265e3dcc1"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:58.888387 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cc9163c4-7c4a-44c6-866b-3e15208594a5 req-b5bd9f99-a773-457f-8722-fdd8ca42f09c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:58.889188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cc9163c4-7c4a-44c6-866b-3e15208594a5 req-b5bd9f99-a773-457f-8722-fdd8ca42f09c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:58.907150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-cc9163c4-7c4a-44c6-866b-3e15208594a5 req-b5bd9f99-a773-457f-8722-fdd8ca42f09c service nova] Creating event network-vif-plugged:694278ed-c102-42be-8044-5a9265e3dcc1 for instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 on hv-cinder-79987 Jul 28 02:21:58.913230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-cc9163c4-7c4a-44c6-866b-3e15208594a5 req-b5bd9f99-a773-457f-8722-fdd8ca42f09c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044874 Jul 28 02:21:58.914082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 266/520] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:59.101486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:59.109970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6da10b6a-88d5-4e51-b557-03302e288fc2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.267876 Jul 28 02:21:59.111472 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 255/521] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:58 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:21:59.270399 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-aac909f1-3a5a-4803-be0d-603993864a22 req-0ebf3133-b2ad-4432-9eed-aa36d313bda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:21:59.280343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-aac909f1-3a5a-4803-be0d-603993864a22 req-0ebf3133-b2ad-4432-9eed-aa36d313bda7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:59.280868 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-aac909f1-3a5a-4803-be0d-603993864a22 req-0ebf3133-b2ad-4432-9eed-aa36d313bda7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:59.291626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-aac909f1-3a5a-4803-be0d-603993864a22 req-0ebf3133-b2ad-4432-9eed-aa36d313bda7 service nova] Creating event network-changed:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:21:59.297384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-aac909f1-3a5a-4803-be0d-603993864a22 req-0ebf3133-b2ad-4432-9eed-aa36d313bda7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030990 Jul 28 02:21:59.297979 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 267/522] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:21:59.631759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:21:59.632514 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:21:59.639569 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:59.640018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:59.640779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:21:59.641259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:21:59.789494 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:21:59.798392 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a00bb10-86c6-4cbf-92dc-b216e840194b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.170445 Jul 28 02:21:59.798966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 256/523] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:21:59 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:22:00.132912 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:00.133628 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:00.141595 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:00.142045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:00.142828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:00.143359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:00.316996 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:00.325220 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f8334f7c-1840-4515-a892-12f4fd1cfcde tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1366 microversion: 2.1 time: 0.197039 Jul 28 02:22:00.325809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 268/524] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:00 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:00.820429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:00.821681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:00.825215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:00.826225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=18 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:00.830450 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:00.830905 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:00.831683 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:00.832124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:00.992261 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:01.001810 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cb90b9a-aa6c-4462-8c55-97154b5a47c8 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.185240 Jul 28 02:22:01.002374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 257/525] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:00 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:01.347193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:01.347802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:01.354822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:01.355304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:01.356124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:01.356672 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:01.790413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:01.798031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8d23b92c-4872-4288-a701-c6a3e94ff392 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1557 microversion: 2.1 time: 0.454796 Jul 28 02:22:01.798603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 269/526] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:01 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1557 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:01.818738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:01.819258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:01.826792 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:01.827414 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:01.828014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:01.828454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:01.914728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aa886e88-a779-42d9-98f2-6a4c0d0342f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099758 Jul 28 02:22:01.915350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 258/527] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:22:01 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:02.024109 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:02.024865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:02.032771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:02.033258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:02.034044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:02.034499 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:02.325165 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:02.333239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f8bb0b1e-c0f5-400f-bfa2-f74007d1db53 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.313227 Jul 28 02:22:02.333909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 270/528] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:02 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:02.975728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-378bc23b-d7d7-4871-97a4-8d57eb9e2edf req-b7b04e03-aba2-40e2-ba2a-fbe2bb7964c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6", "tag": "694278ed-c102-42be-8044-5a9265e3dcc1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:02.986348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-378bc23b-d7d7-4871-97a4-8d57eb9e2edf req-b7b04e03-aba2-40e2-ba2a-fbe2bb7964c6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:02.986797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-378bc23b-d7d7-4871-97a4-8d57eb9e2edf req-b7b04e03-aba2-40e2-ba2a-fbe2bb7964c6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:02.999125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-378bc23b-d7d7-4871-97a4-8d57eb9e2edf req-b7b04e03-aba2-40e2-ba2a-fbe2bb7964c6 service nova] Creating event network-changed:694278ed-c102-42be-8044-5a9265e3dcc1 for instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 on hv-cinder-79987 Jul 28 02:22:03.004466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-378bc23b-d7d7-4871-97a4-8d57eb9e2edf req-b7b04e03-aba2-40e2-ba2a-fbe2bb7964c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033681 Jul 28 02:22:03.005106 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 259/529] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:03.357031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:03.357583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:03.364242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:03.364689 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:03.365491 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:03.365928 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:03.529495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:03.538729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0395f603-4c90-4253-888c-80a460c4ae7c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.187114 Jul 28 02:22:03.539300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 271/530] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:03 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:04.563647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:04.564335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:04.571152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:04.571597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:04.572357 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:04.572791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:04.718470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:04.726747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c71f173f-89e6-4add-a26c-2243903f52e2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.168287 Jul 28 02:22:04.727319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 260/531] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:04 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:05.747950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:05.748545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:05.756843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:05.757316 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:05.758086 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:05.758515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:05.915702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:05.925832 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06eafdfe-2df2-445e-ae7d-d0800b574d2f tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.181630 Jul 28 02:22:05.926409 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 272/532] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:05 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:06.949121 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:06.950179 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:06.956268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:06.956724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:06.957537 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:06.957978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:07.118420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:07.127813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65fef12e-3391-420b-a34a-3faf3ccb44c7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.183023 Jul 28 02:22:07.128406 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 261/533] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:06 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:08.150030 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:08.150707 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:08.158737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:08.159187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:08.159964 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:08.160396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:08.307148 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:08.316346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-50e3290a-0fad-4589-a446-7f87492ba09e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.170197 Jul 28 02:22:08.316942 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 273/534] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:08 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:09.338713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:09.340115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:09.346944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:09.347359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:09.348360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:09.348791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:09.502260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:09.510361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b90e233c-54c5-4ed3-8e1d-d539d9a8ebb4 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1755 microversion: 2.1 time: 0.176254 Jul 28 02:22:09.510947 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 262/535] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:09 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:22:10.532061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:10.532665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:10.539200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:10.539641 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:10.540397 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:10.540827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:10.690269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:10.699041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-01d86d10-600e-4f02-a62a-349caa745026 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1758 microversion: 2.1 time: 0.170579 Jul 28 02:22:10.699875 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 274/536] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:22:10 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:24.873653 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:24.874277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:24.876281 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=20 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:24.877137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=94 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:24.883374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:24.883827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:24.884594 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:24.885058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:24.919559 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fdfee7e9-c42f-4ac7-968f-dab1881c36d8 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments/1fca5363-3ad9-4155-8e6f-48ce496db8bc" status: 200 len: 194 microversion: 2.20 time: 0.051029 Jul 28 02:22:24.920059 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 263/537] 10.222.0.40 () {60 vars in 1454 bytes} [Thu Jul 28 02:22:24 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments/1fca5363-3ad9-4155-8e6f-48ce496db8bc => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:22:24.988022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:24.988561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:24.991187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=28 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:24.991833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=66 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:24.998243 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:24.998687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:24.999457 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:24.999887 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:25.080586 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lazy-loading 'services' on Instance uuid 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:22:25.157374 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-288c5caf-d9bf-40da-b5d9-94f64249f734 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments/1fca5363-3ad9-4155-8e6f-48ce496db8bc" status: 202 len: 0 microversion: 2.20 time: 0.172777 Jul 28 02:22:25.157964 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 275/538] 10.222.0.40 () {60 vars in 1457 bytes} [Thu Jul 28 02:22:24 2022] DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments/1fca5363-3ad9-4155-8e6f-48ce496db8bc => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:22:25.168864 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:25.171181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:25.179160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:25.179616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:25.180816 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:25.181352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:25.214827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2d8b948a-4124-49bb-aeae-029b14913532 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050875 Jul 28 02:22:25.215594 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 264/539] 10.222.0.40 () {60 vars in 1343 bytes} [Thu Jul 28 02:22:25 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:22:26.229700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:26.233440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:26.240445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.240896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.241800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.242263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.271583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32c4fd6a-e08e-4fe6-ba8b-982d06fbded9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047504 Jul 28 02:22:26.272196 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 276/540] 10.222.0.40 () {60 vars in 1343 bytes} [Thu Jul 28 02:22:26 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:22:26.336810 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:26.337397 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:26.344632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.345113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.345904 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.346340 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.371425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:22:26.459283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-87e45503-5fd1-4d7f-ae48-d5de3f8fe8d3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 204 len: 0 microversion: 2.20 time: 0.126130 Jul 28 02:22:26.459907 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 265/541] 10.222.0.40 () {60 vars in 1280 bytes} [Thu Jul 28 02:22:26 2022] DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 02:22:26.469689 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:26.470309 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:26.477226 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.477680 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.478507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:26.478945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:26.621130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:26.629622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:26.631124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:26.632277 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-14fb0529-baf3-4e0b-8c8c-4e844344a663 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.167530 Jul 28 02:22:26.632832 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 277/542] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:26 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:27.657522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:27.658230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:27.664273 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:27.664746 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:27.665590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:27.666030 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:27.802195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:27.811406 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:27.812939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:27.814111 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aaca8546-ba83-4d74-9f72-2dbdf33ac30d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.161467 Jul 28 02:22:27.814664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 266/543] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:27 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:28.837953 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:28.838502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:28.845364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:28.845925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:28.846737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:28.847172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:28.982981 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:28.991174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:28.992697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:28.993967 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a8f0a2b0-2def-47a1-bba2-97230bece2e7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 200 len: 1723 microversion: 2.20 time: 0.160129 Jul 28 02:22:28.994619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 278/544] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:28 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:22:29.327473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-30e1022b-345f-45a1-b2a4-258410a26c8e req-1ad2e745-0792-41dc-8361-4dc2d013fdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f3fd25-2f4e-4cbc-8c43-158fc08ece33", "name": "network-vif-deleted", "tag": "d07f97be-2b00-4c81-a7cf-ea02ac526203"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:29.340117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-30e1022b-345f-45a1-b2a4-258410a26c8e req-1ad2e745-0792-41dc-8361-4dc2d013fdd2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:29.341113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-30e1022b-345f-45a1-b2a4-258410a26c8e req-1ad2e745-0792-41dc-8361-4dc2d013fdd2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:29.354375 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-30e1022b-345f-45a1-b2a4-258410a26c8e req-1ad2e745-0792-41dc-8361-4dc2d013fdd2 service nova] Creating event network-vif-deleted:d07f97be-2b00-4c81-a7cf-ea02ac526203 for instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 on hv-cinder-79987 Jul 28 02:22:29.362711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-30e1022b-345f-45a1-b2a4-258410a26c8e req-1ad2e745-0792-41dc-8361-4dc2d013fdd2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037201 Jul 28 02:22:29.362711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 267/545] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:30.018194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:30.025593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:30.025593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:30.026299 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:30.026495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:30.026975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:30.042241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 HTTP/1.1 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:22:30.044738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:22:30.046523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '37f3fd25-2f4e-4cbc-8c43-158fc08ece33'} Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:22:30.047573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:22:30.049098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:22:30.050422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:22:30.050422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4ceaf1f9-afe5-4e6b-8d88-fe37ca7e5a11 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 404 len: 111 microversion: 2.20 time: 0.032254 Jul 28 02:22:30.050422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 279/546] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:30 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 02:22:30.055827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4166688-c7df-4c12-a116-15475e6a3079 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '.version_select at 0x7efc52f71700>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:30.078487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4166688-c7df-4c12-a116-15475e6a3079 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445458978" status: 204 len: 0 microversion: 2.20 time: 0.026717 Jul 28 02:22:30.079045 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 268/547] 10.222.0.40 () {60 vars in 1259 bytes} [Thu Jul 28 02:22:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445458978 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 02:22:30.800329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eea2cd37-854f-4c38-995c-5fcb0b13695f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: .version_select at 0x7efc52bef820>, body: {"keypair": {"name": "tempest-keypair-1083953056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP3JJsXwJUltdq8ZBpnlWICLh77zWBB5cRT+dePeqh0LmM9NCQkZxHj0F7ECfkR4Hfq7/0QnVnTTmNUI4/pz3fXpoCCLwe5E4qvTKvDW+qVb/mrmnVqRe/7H1D+UjScaw=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:30.816379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-eea2cd37-854f-4c38-995c-5fcb0b13695f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for project 1ed45da3e0024fa597d03299abae9859. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:22:30.820239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-eea2cd37-854f-4c38-995c-5fcb0b13695f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for user 67ffe17468b04aa6ab148a976b5464b4 and project 1ed45da3e0024fa597d03299abae9859. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:22:30.848243 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eea2cd37-854f-4c38-995c-5fcb0b13695f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051824 Jul 28 02:22:30.848846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 280/548] 10.222.0.40 () {62 vars in 1200 bytes} [Thu Jul 28 02:22:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 02:22:32.202384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-745376763", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7a41f53-02ba-4d68-a9f3-9f5c3103be75"}], "security_groups": [{"name": "tempest-securitygroup--655291973"}], "key_name": "tempest-keypair-1083953056", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:32.305588 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] validate_networks() for [('b7a41f53-02ba-4d68-a9f3-9f5c3103be75', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:22:32.718961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:22:32.719386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:22:32.719888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:22:32.720292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:22:32.720699 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:22:32.731702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:32.732141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:32.733037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:32.733523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:32.750580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for project 1ed45da3e0024fa597d03299abae9859. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:22:32.754517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Getting quotas for user 67ffe17468b04aa6ab148a976b5464b4 and project 1ed45da3e0024fa597d03299abae9859. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:22:32.768049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:22:32.770434 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:22:32.816607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9dd34b92-d59c-410d-ad85-347678f8e96d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.619632 Jul 28 02:22:32.817297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 269/549] 10.222.0.40 () {62 vars in 1188 bytes} [Thu Jul 28 02:22:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 02:22:32.829609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:32.830219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:32.890193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:32.897715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:32.899338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:32.900545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da41856b-07d5-45ac-903b-daa4f77c1526 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1281 microversion: 2.20 time: 0.076209 Jul 28 02:22:32.901224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 281/550] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:32 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:33.925476 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:33.926256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:33.933766 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:33.934334 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:33.935377 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:33.935904 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:34.004853 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:34.017772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:34.019372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:34.020497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1d701c31-5ba4-4f0f-94db-da877ff5dbb4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1351 microversion: 2.20 time: 0.100797 Jul 28 02:22:34.021108 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 270/551] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:33 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:22:35.059574 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:35.061708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:35.069104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:35.069524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:35.070296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:35.070731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:35.254434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:35.266307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:35.271937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:35.273729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3a364bb5-c226-4a69-97c6-d300000a8e67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.221085 Jul 28 02:22:35.277916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 282/552] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:35 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:35.597928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-1a242ee5-2e84-40c2-a172-5ab9872b23f7 req-e6864ca1-ac48-436f-b61f-40694c2b23d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:35.619403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1a242ee5-2e84-40c2-a172-5ab9872b23f7 req-e6864ca1-ac48-436f-b61f-40694c2b23d5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:35.620357 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1a242ee5-2e84-40c2-a172-5ab9872b23f7 req-e6864ca1-ac48-436f-b61f-40694c2b23d5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:35.651182 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-1a242ee5-2e84-40c2-a172-5ab9872b23f7 req-e6864ca1-ac48-436f-b61f-40694c2b23d5 service nova] Creating event network-changed:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:22:35.658999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-1a242ee5-2e84-40c2-a172-5ab9872b23f7 req-e6864ca1-ac48-436f-b61f-40694c2b23d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065681 Jul 28 02:22:35.660016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 271/553] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:22:36.300819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:36.301401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:36.309554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:36.310014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:36.310798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:36.311293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:36.458842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:36.468404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:36.470003 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:36.471155 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a147f38-25aa-4c83-80c4-c63254170330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.174551 Jul 28 02:22:36.471720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 283/554] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:36 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:37.495325 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:37.496022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:37.503581 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:37.504025 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:37.504794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:37.505256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:37.654522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:37.663268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:37.664686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:37.665856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17aa05c1-691d-40de-93f2-57b39429aef6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.175303 Jul 28 02:22:37.666632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 272/555] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:37 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:38.690550 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:38.691157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:38.697967 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:38.698802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:38.699865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:38.700304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:38.836737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:38.845944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:38.847743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:38.848854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5dea0328-8652-4746-a3bb-8979e91b83af tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.163252 Jul 28 02:22:38.849433 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 284/556] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:38 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:39.871198 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:39.871778 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:39.879069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:39.879511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:39.880260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:39.880689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:40.008046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:40.015999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:40.017596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:40.018709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-632da32e-380d-41ea-9cdf-2ca6baec2f5c tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.151450 Jul 28 02:22:40.019267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 273/557] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:39 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:41.041794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:41.042406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:41.049351 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:41.049802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:41.050578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:41.051014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:41.099152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-edab90a8-2502-474e-956d-bf3ac15963a6 req-988039b4-eedd-405c-8174-4a77d1e8ccd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "name": "network-vif-plugged", "status": "completed", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:41.110088 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-edab90a8-2502-474e-956d-bf3ac15963a6 req-988039b4-eedd-405c-8174-4a77d1e8ccd1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:41.110652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-edab90a8-2502-474e-956d-bf3ac15963a6 req-988039b4-eedd-405c-8174-4a77d1e8ccd1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:41.122099 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-edab90a8-2502-474e-956d-bf3ac15963a6 req-988039b4-eedd-405c-8174-4a77d1e8ccd1 service nova] Creating event network-vif-plugged:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:22:41.127992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-edab90a8-2502-474e-956d-bf3ac15963a6 req-988039b4-eedd-405c-8174-4a77d1e8ccd1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033044 Jul 28 02:22:41.128603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 274/558] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:41.194609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:41.202987 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:41.204487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:41.205662 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf526340-4891-46b5-8470-73994a738a3a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.167855 Jul 28 02:22:41.206221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 285/559] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:41 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:42.229992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:42.230687 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:42.237783 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:42.238232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:42.238993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:42.239458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:42.372658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:42.380658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:42.382183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:42.383270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-795f554c-6805-4d36-8b7a-64b95ebfdab4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1406 microversion: 2.20 time: 0.158056 Jul 28 02:22:42.383821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 275/560] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:42 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:43.405473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:43.406080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:43.408542 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:43.414083 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:43.414692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:43.415455 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:43.415889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:43.548042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:43.556212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:43.557741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:22:43.558897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb7d2bd3-fc87-49ad-a787-805dbff1720e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1597 microversion: 2.20 time: 0.157337 Jul 28 02:22:43.559455 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 286/561] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:22:43 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:22:43.581674 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:43.582215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:43.584241 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:43.584934 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:43.591015 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:43.591466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:43.592227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:43.592661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:43.677485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1dbe8838-357c-4c8c-999f-d23e208f20e9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099641 Jul 28 02:22:43.678080 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 276/562] 10.222.0.40 () {60 vars in 1316 bytes} [Thu Jul 28 02:22:43 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:22:44.857127 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-6393b24d-bbfe-4091-ac5f-529cc4278999 req-ea75bbcd-192c-4520-aa09-10be891f6590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:44.866883 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-6393b24d-bbfe-4091-ac5f-529cc4278999 req-ea75bbcd-192c-4520-aa09-10be891f6590 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:44.867442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-6393b24d-bbfe-4091-ac5f-529cc4278999 req-ea75bbcd-192c-4520-aa09-10be891f6590 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:44.878204 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-6393b24d-bbfe-4091-ac5f-529cc4278999 req-ea75bbcd-192c-4520-aa09-10be891f6590 service nova] Creating event network-changed:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:22:44.883242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-6393b24d-bbfe-4091-ac5f-529cc4278999 req-ea75bbcd-192c-4520-aa09-10be891f6590 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029678 Jul 28 02:22:44.883826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 287/563] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:49.770289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:49.770858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:49.776933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:49.777384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:49.778141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:49.778576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:49.802382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6e5aab35-edf1-464a-bfd2-a68d9540ae70 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/ips" status: 200 len: 151 microversion: 2.1 time: 0.036571 Jul 28 02:22:49.802950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 277/564] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:22:49 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:51.134331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fed5263-1c69-4af8-a372-75a109de6204"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:51.136691 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:51.144067 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:51.144507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:51.145310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:51.145746 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:51.385292 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc466945-d0ef-4f30-8b2e-032256c2a78d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254989 Jul 28 02:22:51.385894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 288/565] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:22:51 2022] POST /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:54.487002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bb21107-f7d9-42f4-bc3b-8d7d6bad271e"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:54.489336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:54.495951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:54.496400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:54.497194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:54.497635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:54.747013 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-746681de-d69c-4ea5-b346-1594cf76c4f5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264426 Jul 28 02:22:54.747567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 278/566] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:22:54 2022] POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:57.029530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1151990054"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:57.030606 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:57.032310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:57.038168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:57.038639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:57.039519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:57.039983 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:57.043253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:57.177013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.network.security_group_api [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Removing security group 0df0a0cc-736e-439c-8afe-793336d59f6c from port 69119806-930f-400d-b217-df9b4467529b Jul 28 02:22:57.582446 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-adbd1299-ebe3-432f-937d-7b997bc01bf7 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action" status: 202 len: 0 microversion: 2.1 time: 0.557968 Jul 28 02:22:57.583066 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 289/567] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:22:57 2022] POST /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:22:57.597652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2fb28cb6-9ef1-4509-b5c6-d7020c30fadc req-6f9ee04c-8a79-4c68-9af6-671ba61f658b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:57.602897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:57.610105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2fb28cb6-9ef1-4509-b5c6-d7020c30fadc req-6f9ee04c-8a79-4c68-9af6-671ba61f658b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:57.611133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2fb28cb6-9ef1-4509-b5c6-d7020c30fadc req-6f9ee04c-8a79-4c68-9af6-671ba61f658b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:57.629955 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:22:57.632570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2fb28cb6-9ef1-4509-b5c6-d7020c30fadc req-6f9ee04c-8a79-4c68-9af6-671ba61f658b service nova] Creating event network-changed:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:22:57.639616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2fb28cb6-9ef1-4509-b5c6-d7020c30fadc req-6f9ee04c-8a79-4c68-9af6-671ba61f658b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047730 Jul 28 02:22:57.641260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 279/568] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:58.809217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:58.809760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:58.816424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:58.816906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:58.817672 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:58.818106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:58.915136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lazy-loading 'services' on Instance uuid f02f5086-2cc1-4595-a941-d48a15c52dbf {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:22:58.984930 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fed5263-1c69-4af8-a372-75a109de6204"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:58.992565 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:59.004031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.004570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.005139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8d348b19-8aa7-456c-a23e-07fc9ffac8e9 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments/89250cc4-965e-40d6-b058-889dd692215b" status: 202 len: 0 microversion: 2.1 time: 0.200234 Jul 28 02:22:59.005521 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.010041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.011547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 290/569] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:22:58 2022] DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments/89250cc4-965e-40d6-b058-889dd692215b => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:22:59.017193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:59.021209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:59.027853 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.028258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.029119 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.029793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.066621 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fcdf6007-504b-4a3a-9ed1-87f4c5db032b tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055019 Jul 28 02:22:59.067405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 291/570] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:22:59 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:59.120953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments HTTP/1.1 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 74 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:22:59.123772 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "7fed5263-1c69-4af8-a372-75a109de6204"}} Jul 28 02:22:59.125482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'd907d04a-4c0b-4e3c-a7df-a3eeb192a2b6', 'body': {'volumeAttachment': {'volumeId': '7fed5263-1c69-4af8-a372-75a109de6204'}}} Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:22:59.126353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:22:59.131141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 400 to user: Invalid volume: volume 7fed5263-1c69-4af8-a372-75a109de6204 is already attached to instances: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-030413bd-67ea-40cc-b4e2-ecc0bf004fee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147081 Jul 28 02:22:59.132593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 280/571] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:22:58 2022] POST /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 02:22:59.220177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:59.220664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:59.227126 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.227568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.228489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.228843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.316452 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'services' on Instance uuid d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:22:59.393406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2036749a-f1e0-4160-921d-b888a0bb434c tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments/7fed5263-1c69-4af8-a372-75a109de6204" status: 202 len: 0 microversion: 2.1 time: 0.177538 Jul 28 02:22:59.394135 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 292/572] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:22:59 2022] DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments/7fed5263-1c69-4af8-a372-75a109de6204 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:22:59.409093 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:22:59.411379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:22:59.419567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.420008 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.420790 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.421689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.469618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3ee8028c-87b0-4099-bf86-5e5ad15b99f0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064599 Jul 28 02:22:59.470974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 281/573] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:22:59 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:22:59.658149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1441b664-75cc-4506-b130-701ab31b7262 req-de23af75-636d-49ea-a555-d828d22c214e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:22:59.668426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1441b664-75cc-4506-b130-701ab31b7262 req-de23af75-636d-49ea-a555-d828d22c214e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:22:59.668893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1441b664-75cc-4506-b130-701ab31b7262 req-de23af75-636d-49ea-a555-d828d22c214e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:22:59.682466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1441b664-75cc-4506-b130-701ab31b7262 req-de23af75-636d-49ea-a555-d828d22c214e service nova] Creating event network-changed:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:22:59.688536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1441b664-75cc-4506-b130-701ab31b7262 req-de23af75-636d-49ea-a555-d828d22c214e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033717 Jul 28 02:22:59.689187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 293/574] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:00.080543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:00.082817 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:00.089399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:00.089852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:00.090625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:00.091065 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:00.121802 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e7952d11-693e-4490-9044-7badf2f9adaf tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046141 Jul 28 02:23:00.122388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 282/575] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:00 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:00.486903 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:00.489253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:00.495631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:00.496080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:00.496833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:00.497289 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:00.527292 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b247d489-3f22-483e-a103-d465a4d112d8 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Jul 28 02:23:00.527846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 294/576] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:00 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:01.134408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:01.136589 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:01.144451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:01.144917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:01.145720 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:01.146156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:01.175227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7e95a967-1daf-4910-95f1-0b962c33fc61 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Jul 28 02:23:01.175795 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 283/577] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:01 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:01.539888 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:01.542073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:01.549529 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:01.549972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:01.550743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:01.551173 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:01.582991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-446d6a13-d3c7-4863-840d-8f2fb9fe5f89 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Jul 28 02:23:01.583561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 295/578] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:01 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:02.186978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:02.189173 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:02.195594 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:02.196035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:02.196784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:02.197253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:02.226672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a78da04a-6f3a-4f59-94d1-33bd695d2d9e tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Jul 28 02:23:02.227219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 284/579] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:02 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:02.594743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:02.597219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:02.604064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:02.604509 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:02.605295 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:02.605724 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:02.634496 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1fb4c1bb-1d5c-44be-baf3-4ecb63449659 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Jul 28 02:23:02.635046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 296/580] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:02 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:03.239848 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:03.242020 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:03.248599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:03.249094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:03.249855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:03.250289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:03.285148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bdffd0c1-92cd-46c9-aec2-b07bc6d93837 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049247 Jul 28 02:23:03.285723 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 285/581] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:03 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:03.647264 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:03.649625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:03.656195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:03.656646 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:03.657445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:03.657884 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:03.688408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2e0e61fd-417b-4692-a6de-120772da664b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Jul 28 02:23:03.689058 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 297/582] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:03 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:04.303464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:04.305808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:04.312891 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:04.313345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:04.314113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:04.314546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:04.344670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ddab7f8d-5d76-48fb-bee1-ab94e6bb14d2 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050462 Jul 28 02:23:04.345241 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 286/583] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:04 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:23:04.702275 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:04.705118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:04.711708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:04.712154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:04.712950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:04.713388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:04.743212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8754c858-f983-4d42-a5e9-8718b4dcee5e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Jul 28 02:23:04.743778 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 298/584] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:04 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:05.357633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:05.359705 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:05.367049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.367500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.368253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.368682 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.396468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-33115521-f5d1-4337-93b7-fda123c2d772 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Jul 28 02:23:05.397051 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 287/585] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:05 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:05.576344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:05.578538 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:05.584600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.585237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.585855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.586286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.609573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'flavor' on Instance uuid c55cbbcb-d9ea-4797-a39a-b663942e8ff6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:23:05.755782 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:05.758174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:05.764333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.764780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.765563 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.766246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.795846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27eecc63-dd51-4741-81ae-8e305095c57a tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Jul 28 02:23:05.796401 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 288/586] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:05 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:23:05.896474 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5de85287-cb96-43ee-9e44-0f3cd3cc6c6e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/action" status: 200 len: 32 microversion: 2.1 time: 0.323977 Jul 28 02:23:05.897238 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 299/587] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:23:05 2022] POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:23:05.910479 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:05.912016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:05.921556 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.922065 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:05.923096 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:05.923620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.166141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:06.175300 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1e904d0a-2ad4-4f37-b1dc-ce0c2e78a8df tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.271003 Jul 28 02:23:06.175878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 289/588] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:05 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:06.408659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:06.410855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:06.417487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.417938 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.418717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.419155 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.448360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6f52df11-a675-4123-bfb2-4e1040a7d991 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044371 Jul 28 02:23:06.448949 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 300/589] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:06 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:23:06.461141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:06.461719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:06.468714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.469207 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.470044 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.470520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.598268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] HTTP exception thrown: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf is not attached to volume 89250cc4-965e-40d6-b058-889dd692215b Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Request method failure captured: Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments/89250cc4-965e-40d6-b058-889dd692215b HTTP/1.1 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fIz0tqNOCtT_5f0QpicD5kjaSeFRBBI7GgCS0kLRsnt7af8v2hGNI7aRymawh9uWFv-_14LvyJOF-3RumRejeN6zmNsXW1faZCtSl7_ZaHVIJRbJrVhU5XFnXVL5e3u6pJa7EVSTn6VeoB44c71p8PvmcQGwimIiKtoiuSDRUEAfM0 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 9cb7e92c703a42d6be6343c04934d533 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:23:06.613018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 9cb7e92c703a42d6be6343c04934d533 Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-TestMinimumBasicScenario-1783824357-project Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: c4947dc5e05c42518cd697a3d21643cc Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestMinimumBasicScenario-1783824357-project Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:23:06.614640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf is not attached to volume 89250cc4-965e-40d6-b058-889dd692215b Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'f02f5086-2cc1-4595-a941-d48a15c52dbf', 'id': '89250cc4-965e-40d6-b058-889dd692215b'} Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89250cc4-965e-40d6-b058-889dd692215b. Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:23:06.615429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf is not attached to volume 89250cc4-965e-40d6-b058-889dd692215b Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf is not attached to volume 89250cc4-965e-40d6-b058-889dd692215b Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:06.616571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Returning 404 to user: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf is not attached to volume 89250cc4-965e-40d6-b058-889dd692215b {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:23:06.617482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3cfa141a-2487-40e8-8d39-42ef10895559 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments/89250cc4-965e-40d6-b058-889dd692215b" status: 404 len: 154 microversion: 2.1 time: 0.158561 Jul 28 02:23:06.617482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 290/590] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:23:06 2022] DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf/os-volume_attachments/89250cc4-965e-40d6-b058-889dd692215b => generated 154 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:23:06.807791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:06.809966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:06.818223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.818923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.819704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.820143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.850181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-81e710b8-1acb-4e61-9b69-bff8bf4147f6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046300 Jul 28 02:23:06.851056 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 301/591] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:23:06 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:23:06.918221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:06.919998 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:06.927307 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.927761 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.928835 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:06.929312 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:06.957509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:23:07.047626 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fcca857a-0ee4-415f-8ddd-6e4e4fd46468 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 204 len: 0 microversion: 2.1 time: 0.126968 Jul 28 02:23:07.047626 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 291/592] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:23:06 2022] DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:23:07.058774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:07.058774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:07.066025 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.066475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.067310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.067774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.197053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:07.197666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:07.203735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.204193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.204806 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:07.205659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.206337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.213233 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b08d9cf7-2a9f-4777-bd17-655910879e68 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1682 microversion: 2.1 time: 0.159539 Jul 28 02:23:07.213895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 302/593] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:07 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:07.336349 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:07.344202 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f519db35-fbc5-4078-bba1-d35ade81ce5e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.151553 Jul 28 02:23:07.344989 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 292/594] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:07 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:07.757250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:07.757736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:07.763693 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.764136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.764908 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.765341 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.779717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:07.790709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:23:07.864008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fce6e86d-556e-4ee6-9191-9925f8bf1ccc tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 204 len: 0 microversion: 2.1 time: 0.110305 Jul 28 02:23:07.864583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 303/595] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:23:07 2022] DELETE /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:23:07.872607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:07.873258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:07.879821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.880274 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:07.881103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:07.881568 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:08.014926 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:08.023046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e263c8c0-9dc4-4b36-b826-074e55644093 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1553 microversion: 2.1 time: 0.154226 Jul 28 02:23:08.023613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 293/596] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:07 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:08.236030 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:08.237400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:08.243908 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:08.244356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:08.245155 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:08.245587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:08.366045 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:08.367025 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:08.373351 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:08.373791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:08.374576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:08.375590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:08.391205 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:08.400487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ae23c4b-c64e-467f-b020-2107c7a57263 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1682 microversion: 2.1 time: 0.168670 Jul 28 02:23:08.401483 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 304/597] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:08 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:08.527014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:08.529454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:08.537226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5262cdde-c14b-45d9-a6cb-fa5b330d3e1c tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.175014 Jul 28 02:23:08.537815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 294/598] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:08 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:09.046539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:09.047147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:09.054782 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.055224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.055982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.056406 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.198897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:09.206848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-95f871d8-c542-4048-b3fc-257fc7be7288 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1553 microversion: 2.1 time: 0.164181 Jul 28 02:23:09.207430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 305/599] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:09 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:09.427646 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:09.428250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:09.436291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.436738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.437532 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.437966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.559299 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:09.559881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:09.566268 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.566946 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.567825 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:09.568262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:09.569992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:09.577776 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07f328c2-f9a8-42de-a39e-501167b304d0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1682 microversion: 2.1 time: 0.154582 Jul 28 02:23:09.578278 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 295/600] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:09 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:09.710143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:09.718340 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e3d73709-3262-4a13-9220-6ca0bb8d981f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.162949 Jul 28 02:23:09.718906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 306/601] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:09 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:10.229069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:10.229681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:10.235944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.236398 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.237264 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.237657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.400014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:10.409973 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-44b5b343-f0a7-497a-917f-f3065d860431 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1553 microversion: 2.1 time: 0.182957 Jul 28 02:23:10.411099 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 296/602] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:10 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:10.601639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:10.602410 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:10.608743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.609283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.610444 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.611209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.741427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:10.742738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:10.749795 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.750237 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.751044 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:10.751467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:10.790787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:10.799472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fd3f2aa1-017d-4315-b6e2-4f38f9a7a850 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1682 microversion: 2.1 time: 0.202718 Jul 28 02:23:10.800448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 307/603] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:10 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:10.914620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:10.923162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c7c1797-6d87-4d57-adaf-2a0d7bf6ebd5 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.187183 Jul 28 02:23:10.923851 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 297/604] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:10 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:11.443239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:11.443872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:11.450417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.451144 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.452141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.452394 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.513773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2f776bd6-d847-4033-8a7d-d0d40a319d6c req-a8d7ec36-e4e7-4c2d-b64b-a3379a9c341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02f5086-2cc1-4595-a941-d48a15c52dbf", "name": "network-vif-deleted", "tag": "69119806-930f-400d-b217-df9b4467529b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:11.544380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4947dc5e05c42518cd697a3d21643cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cb7e92c703a42d6be6343c04934d533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:11.547504 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2f776bd6-d847-4033-8a7d-d0d40a319d6c req-a8d7ec36-e4e7-4c2d-b64b-a3379a9c341c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.548200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2f776bd6-d847-4033-8a7d-d0d40a319d6c req-a8d7ec36-e4e7-4c2d-b64b-a3379a9c341c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.556064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4223cc6-3ca5-46d9-8d5c-efed008b1605 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 200 len: 1511 microversion: 2.1 time: 0.120175 Jul 28 02:23:11.556677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 308/605] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:11 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 1511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:11.569188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2f776bd6-d847-4033-8a7d-d0d40a319d6c req-a8d7ec36-e4e7-4c2d-b64b-a3379a9c341c service nova] Creating event network-vif-deleted:69119806-930f-400d-b217-df9b4467529b for instance f02f5086-2cc1-4595-a941-d48a15c52dbf on hv-cinder-79987 Jul 28 02:23:11.579166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2f776bd6-d847-4033-8a7d-d0d40a319d6c req-a8d7ec36-e4e7-4c2d-b64b-a3379a9c341c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079279 Jul 28 02:23:11.579821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 298/606] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:11.827081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:11.827706 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:11.836031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.836489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.837322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.837766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.931249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:11.949298 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:11.950490 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:11.960930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-90cc5ced-7e5e-48e2-9c9a-115247cf691f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 200 len: 1615 microversion: 2.1 time: 0.137636 Jul 28 02:23:11.966203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.982427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:11.983543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 309/607] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:11 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 1615 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:11.984004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:11.984465 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:12.198530 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:12.213256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c8eb4ae8-d153-4479-bfd7-e2f69a5ac4dc tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.270098 Jul 28 02:23:12.214510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 299/608] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:11 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:12.583817 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:12.584769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] [instance: f02f5086-2cc1-4595-a941-d48a15c52dbf] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:12.597348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:12.598046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:12.599468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:12.600258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:12.628211 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] HTTP exception thrown: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Request method failure captured: Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf HTTP/1.1 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fIz0tqNOCtT_5f0QpicD5kjaSeFRBBI7GgCS0kLRsnt7af8v2hGNI7aRymawh9uWFv-_14LvyJOF-3RumRejeN6zmNsXW1faZCtSl7_ZaHVIJRbJrVhU5XFnXVL5e3u6pJa7EVSTn6VeoB44c71p8PvmcQGwimIiKtoiuSDRUEAfM0 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 9cb7e92c703a42d6be6343c04934d533 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:23:12.632358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9cb7e92c703a42d6be6343c04934d533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 9cb7e92c703a42d6be6343c04934d533 Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1783824357 Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-TestMinimumBasicScenario-1783824357-project Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: c4947dc5e05c42518cd697a3d21643cc Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestMinimumBasicScenario-1783824357-project Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. Jul 28 02:23:12.634024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'f02f5086-2cc1-4595-a941-d48a15c52dbf'} Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:23:12.634910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. Jul 28 02:23:12.636328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:12.637952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Returning 404 to user: Instance f02f5086-2cc1-4595-a941-d48a15c52dbf could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:23:12.637952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4527161-8274-4a37-b480-278b10ab2a63 tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf" status: 404 len: 111 microversion: 2.1 time: 0.055799 Jul 28 02:23:12.640945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 310/609] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:12 2022] GET /compute/v2.1/servers/f02f5086-2cc1-4595-a941-d48a15c52dbf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:23:12.646509 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0aa1d090-ff94-4ead-8710-a60eb33e8c1c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] Calling method '.version_select at 0x7efc52f71280>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:12.669149 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0aa1d090-ff94-4ead-8710-a60eb33e8c1c tempest-TestMinimumBasicScenario-1783824357 tempest-TestMinimumBasicScenario-1783824357-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-173523979" status: 202 len: 0 microversion: 2.1 time: 0.026947 Jul 28 02:23:12.669986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 300/610] 10.222.0.40 () {58 vars in 1269 bytes} [Thu Jul 28 02:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-173523979 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:23:12.991582 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:12.992200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:13.007052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:13.007607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:13.008590 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:13.009082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:13.032218 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 HTTP/1.1 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:23:13.035279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:23:13.037564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'd907d04a-4c0b-4e3c-a7df-a3eeb192a2b6'} Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:23:13.038611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:23:13.039990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:13.041248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:23:13.041248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1daa3929-a03d-4d5c-9268-58fb1322d1f4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 404 len: 111 microversion: 2.1 time: 0.049957 Jul 28 02:23:13.041248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 311/611] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:12 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:23:13.052491 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1602e692-690b-4cf9-b588-fbf691007c59 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '.version_select at 0x7efc52e76550>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:13.092607 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1602e692-690b-4cf9-b588-fbf691007c59 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136208811" status: 202 len: 0 microversion: 2.1 time: 0.046859 Jul 28 02:23:13.100651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 301/612] 10.222.0.40 () {58 vars in 1218 bytes} [Thu Jul 28 02:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136208811 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:23:13.242424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:13.243082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:13.250370 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:13.250919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:13.252167 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:13.253584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:13.479230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:13.497417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bb13c840-759b-412f-842d-cfaf4780f01e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.258470 Jul 28 02:23:13.498809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 312/613] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:13 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:13.820632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a83b1a7e-8e56-4421-ad58-ec6d8b7be943 req-390e214a-94fc-4189-890f-8f86783f5e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6", "name": "network-vif-deleted", "tag": "694278ed-c102-42be-8044-5a9265e3dcc1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:13.831606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a83b1a7e-8e56-4421-ad58-ec6d8b7be943 req-390e214a-94fc-4189-890f-8f86783f5e16 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:13.832052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a83b1a7e-8e56-4421-ad58-ec6d8b7be943 req-390e214a-94fc-4189-890f-8f86783f5e16 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:13.845920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a83b1a7e-8e56-4421-ad58-ec6d8b7be943 req-390e214a-94fc-4189-890f-8f86783f5e16 service nova] Creating event network-vif-deleted:694278ed-c102-42be-8044-5a9265e3dcc1 for instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 on hv-cinder-79987 Jul 28 02:23:13.853350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a83b1a7e-8e56-4421-ad58-ec6d8b7be943 req-390e214a-94fc-4189-890f-8f86783f5e16 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036774 Jul 28 02:23:13.855026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 302/614] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:14.194419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2179a36e-d485-4c2d-bb34-29720dd9e807 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: .version_select at 0x7efc52b8a8b0>, body: {"keypair": {"name": "tempest-keypair-780997462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTvRi/rwxd/aVrR5enz0Bxsw0ehWr8fFTYtbz8uTfkMVD7mgm4dszbqmpQ79PRFhx8Vcj7qMzUs551QMq7LwSmRrDLZo3J1idTw2Feq23rMpmJLxTIcd//YlDmKPSBu9Q=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:14.212780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-2179a36e-d485-4c2d-bb34-29720dd9e807 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:23:14.216817 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-2179a36e-d485-4c2d-bb34-29720dd9e807 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:23:14.245331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2179a36e-d485-4c2d-bb34-29720dd9e807 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056694 Jul 28 02:23:14.245925 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 313/615] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:23:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:14.525907 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:14.527967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:14.537268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:14.538217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:14.539018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:14.539455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:14.789255 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:14.798531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb0531db-69b8-4169-a075-5f1511d965b4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.277885 Jul 28 02:23:14.812649 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 303/616] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:14 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:15.825635 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:15.826253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:15.837284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:15.837934 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:15.839206 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:15.839649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:15.851704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1399112055", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda255f1-8497-41f0-9d65-8f281bd7eb0d"}], "security_groups": [{"name": "tempest-securitygroup--33706682"}], "key_name": "tempest-keypair-780997462", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:16.092091 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] validate_networks() for [('bda255f1-8497-41f0-9d65-8f281bd7eb0d', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:23:16.192684 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:16.201482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d354c0d4-c3d6-48ce-b893-fee95a04400e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.381332 Jul 28 02:23:16.212386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 314/617] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:15 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:16.834830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:23:16.835498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:23:16.836071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:23:16.837785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:23:16.837785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:23:16.846902 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:16.847328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:16.848115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:16.848551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:16.866973 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:23:16.871144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Getting quotas for user 4b5032b52a39454e91d7154b36f85894 and project f4622eae14dd460dbd4e51d4a0413e5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:23:16.884220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:23:16.886609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:23:16.946865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb992a7a-7b49-41ba-a91d-9d7a1c516515 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.100830 Jul 28 02:23:16.956618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 304/618] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:23:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:23:16.964055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ed15978-928e-4c9d-884a-79e5b7398ba9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:16.969200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ed15978-928e-4c9d-884a-79e5b7398ba9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:17.050870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ed15978-928e-4c9d-884a-79e5b7398ba9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:17.060659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ed15978-928e-4c9d-884a-79e5b7398ba9 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1241 microversion: 2.1 time: 0.103058 Jul 28 02:23:17.061598 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 315/619] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:16 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:17.229019 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:17.234052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:17.255094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:17.255549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:17.256346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:17.256948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:17.477066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:17.496247 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-92618927-52f0-40c6-b84c-abae9a3617de tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.272722 Jul 28 02:23:17.512902 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 305/620] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:17 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:18.182833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:18.183549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:18.192071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:18.192520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:18.193346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:18.193818 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:18.290978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:18.304675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b1f1b65-de91-47bb-9245-4d9d594635c2 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1293 microversion: 2.1 time: 0.224031 Jul 28 02:23:18.304990 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 316/621] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:18 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1293 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:18.539760 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:18.542656 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:18.556675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:18.557329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:18.558383 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:18.559062 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:18.831852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:18.844857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-775b08c6-9319-4cf4-8df0-98853af48e8f tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.319032 Jul 28 02:23:18.847482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 306/622] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:18 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:19.328820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:19.330812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:19.338325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:19.338776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:19.340291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:19.340291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:19.592417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:19.606988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6baa701c-7119-4f9e-9e1c-0ec0ce30227e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.282319 Jul 28 02:23:19.610361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 317/623] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:19 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:19.873523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:19.874671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:19.889979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:19.890787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:19.892524 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:19.895909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:20.224451 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:20.233727 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3d260642-1f08-480d-9cb7-5172cae2dcd4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.367739 Jul 28 02:23:20.249635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 307/624] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:19 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:20.370846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-20a7f7bd-5561-4450-93f1-de9d5b4bc564 req-0f96313d-39d1-4ff4-9d12-9d5e9dc8e962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3dc3c2-86d2-426f-826d-8ee87df1dbd9", "tag": "2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:20.407307 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-20a7f7bd-5561-4450-93f1-de9d5b4bc564 req-0f96313d-39d1-4ff4-9d12-9d5e9dc8e962 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:20.408023 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-20a7f7bd-5561-4450-93f1-de9d5b4bc564 req-0f96313d-39d1-4ff4-9d12-9d5e9dc8e962 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:20.424526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-20a7f7bd-5561-4450-93f1-de9d5b4bc564 req-0f96313d-39d1-4ff4-9d12-9d5e9dc8e962 service nova] Creating event network-changed:2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1 for instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 on hv-cinder-79987 Jul 28 02:23:20.434197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-20a7f7bd-5561-4450-93f1-de9d5b4bc564 req-0f96313d-39d1-4ff4-9d12-9d5e9dc8e962 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075011 Jul 28 02:23:20.434197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 318/625] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:20.639611 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:20.640582 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:20.649363 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:20.650162 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:20.651185 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:20.651833 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:20.970423 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:20.984339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-04cfa2d2-dfdc-42a7-986a-a255f243ed87 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.349167 Jul 28 02:23:20.990416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 308/626] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:20 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:21.093642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:21.095216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:21.104474 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:21.104967 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:21.106993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:21.107310 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:21.137192 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-92d63bb1-6d52-467f-945b-0f1ee87f2176 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/ips" status: 200 len: 151 microversion: 2.20 time: 0.129162 Jul 28 02:23:21.137988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 319/627] 10.222.0.40 () {60 vars in 1289 bytes} [Thu Jul 28 02:23:21 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/ips => generated 151 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 02:23:21.263050 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:21.264782 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:21.276214 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:21.277197 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:21.278707 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:21.280228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:21.539945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:21.559063 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d7630631-3096-4334-9d5d-1212ee64af62 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.303159 Jul 28 02:23:21.560838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 309/628] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:21 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:22.019158 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:22.021115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:22.032372 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:22.033046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:22.034355 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:22.035138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:22.217667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:22.226204 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7d8dcbe8-f087-4911-b7e2-126ddb23c471 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.213618 Jul 28 02:23:22.226898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 320/629] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:22 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:22.590496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:22.591314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:22.599443 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:22.599981 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:22.600850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:22.601686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:23.250431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:23.251835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:23.254728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:23.266261 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:23.268072 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:23.270087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:23.270913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:23.277935 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c2d938d2-efc1-4c17-9378-52b05f9fbb43 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.692063 Jul 28 02:23:23.281300 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 310/630] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:22 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:23.565091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:23.575623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fcb1bdcd-3149-47d1-b1a1-72d7a0f02d9b tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.330097 Jul 28 02:23:23.594395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 321/631] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:23 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:23.689761 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:23.690520 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:23.698001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:23.698457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:23.699599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:23.700345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:23.731016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lazy-loading 'flavor' on Instance uuid 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:23:24.057064 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1982c6dc-2098-477a-9713-b50a0783c587 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/action" status: 202 len: 0 microversion: 2.20 time: 0.372265 Jul 28 02:23:24.057668 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 311/632] 10.222.0.40 () {62 vars in 1319 bytes} [Thu Jul 28 02:23:23 2022] POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:23:24.071091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:24.072167 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:24.078483 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.079256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.080109 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.080816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.277955 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:24.280379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:24.289702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:24.291290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:24.292524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cdcc2f42-abc7-4ca5-88bb-a89ecfb9a5df tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.229870 Jul 28 02:23:24.293131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 322/633] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:24 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:24.312613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:24.313501 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:24.324439 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.325147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.326182 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.326748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.510033 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:24.518875 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7dee86f7-f23d-45b5-8319-c80bbe011a78 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1736 microversion: 2.1 time: 0.215094 Jul 28 02:23:24.519464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 312/634] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:24 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:24.602334 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:24.602959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:24.610886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.612219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.613413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:24.613847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:24.794926 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:24.802461 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f2cdc865-3d28-42d2-b9bf-215169347411 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.204546 Jul 28 02:23:24.803034 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 323/635] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:24 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:25.321459 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-249d9acc-7c33-4c50-906c-2e31eae8b81e req-7029df52-733b-41e3-85ab-77888b9f61e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3dc3c2-86d2-426f-826d-8ee87df1dbd9", "name": "network-vif-plugged", "status": "completed", "tag": "2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:25.322435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:25.323312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:25.340642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.341844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.343724 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.344762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.347046 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-249d9acc-7c33-4c50-906c-2e31eae8b81e req-7029df52-733b-41e3-85ab-77888b9f61e6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.348275 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-249d9acc-7c33-4c50-906c-2e31eae8b81e req-7029df52-733b-41e3-85ab-77888b9f61e6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.372742 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-249d9acc-7c33-4c50-906c-2e31eae8b81e req-7029df52-733b-41e3-85ab-77888b9f61e6 service nova] Creating event network-vif-plugged:2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1 for instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 on hv-cinder-79987 Jul 28 02:23:25.383484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-249d9acc-7c33-4c50-906c-2e31eae8b81e req-7029df52-733b-41e3-85ab-77888b9f61e6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071399 Jul 28 02:23:25.385526 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 313/636] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:25.556828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:25.558838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:25.574153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.574153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.574153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.574153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.582246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:25.584510 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:25.599969 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:25.602171 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:25.603431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1446b589-69ad-4b33-acc7-af7dc599ac69 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.289484 Jul 28 02:23:25.604006 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 324/637] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:25 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:25.767103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:25.776164 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3fc472e3-564c-41c7-8e4d-e896479ca853 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1716 microversion: 2.1 time: 0.234033 Jul 28 02:23:25.776755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 314/638] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:25 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1716 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:25.824994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:25.825507 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:25.832692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.833178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.834008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.834439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.898669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:25.899181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:25.905768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.906228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:25.907055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:25.907497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.000860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] HTTP exception thrown: Cannot 'detach_volume' instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 while it is in vm_state rescued Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Request method failure captured: Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments/7bb21107-f7d9-42f4-bc3b-8d7d6bad271e HTTP/1.1 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fI4YAiSBti0RGiamXJLr054Mccmo8rvde74uwjbQj0UtXB7BOuTcPsV4Bb9rWvj09egroTr6tu_RM6MWvtSlPWQP5ZtWXS8wTkrpo5ANOwpnyuyMXk7bGYvEqmPWkn6wCUkTS-5qVTh8T8iTjyMtRSbIVt0jdrHDfkdolNqTT8IX30 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:23:26.003234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5157a5b7f25482980f925175adf2090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5157a5b7f25482980f925175adf2090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 50a2f75083ec40f3a6254c25b57862ae Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:23:26.004951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Cannot 'detach_volume' instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 while it is in vm_state rescued Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'c55cbbcb-d9ea-4797-a39a-b663942e8ff6', 'id': '7bb21107-f7d9-42f4-bc3b-8d7d6bad271e'} Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:23:26.005953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 while it is in vm_state rescued Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 while it is in vm_state rescued Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:23:26.007279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Returning 409 to user: Cannot 'detach_volume' instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 while it is in vm_state rescued {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:23:26.008457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5cbf8ca8-bc12-40e7-b31d-ee46795470a6 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments/7bb21107-f7d9-42f4-bc3b-8d7d6bad271e" status: 409 len: 152 microversion: 2.1 time: 0.110804 Jul 28 02:23:26.009085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 315/639] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:23:25 2022] DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments/7bb21107-f7d9-42f4-bc3b-8d7d6bad271e => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 02:23:26.012769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:26.017052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:26.017979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:26.020843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:26.028578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92998fa-036b-49a3-aa07-b19472c69f45 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.207148 Jul 28 02:23:26.029544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.029949 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 325/640] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:25 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:26.030136 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.030789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.031221 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.112543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-12fbce3b-d07f-4739-b4ce-1074cd068716 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/action" status: 202 len: 0 microversion: 2.1 time: 0.101670 Jul 28 02:23:26.116262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 316/641] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:23:26 2022] POST /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:23:26.121929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:26.122541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:26.129335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.129790 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.131049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.131049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.285296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:26.294101 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c2ffeddf-a36d-4260-9c35-b4c2907a24fa tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1724 microversion: 2.1 time: 0.176137 Jul 28 02:23:26.294736 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 326/642] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:26 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:26.629445 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:26.630262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:26.637302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.637753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.638535 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:26.638970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:26.800156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:26.817680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:26.821037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:26.823389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e739923b-98fb-48ea-bf52-d6cdd9b603f4 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.199482 Jul 28 02:23:26.824462 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 317/643] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:26 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:23:27.055034 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:27.055660 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:27.059378 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:27.062784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:27.065442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.065922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.066772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.067322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.214404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:27.222866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-87c2f35b-687c-4f99-a566-5c68d634ce17 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1365 microversion: 2.1 time: 0.171743 Jul 28 02:23:27.223449 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 327/644] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:27 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:27.319541 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:27.320984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:27.325883 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:27.326941 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:27.334881 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.335646 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.337014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.337787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.501341 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:27.510300 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-75f6096e-4916-4c5c-b306-1607942b25f0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1724 microversion: 2.1 time: 0.197932 Jul 28 02:23:27.510974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 318/645] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:27 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:27.850661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:27.851180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:27.857388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.857861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.858622 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:27.859054 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:27.990046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:27.998251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:27.999851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:28.001040 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd7f8b5a-ecbe-4746-8fcb-5e2502b89762 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.154377 Jul 28 02:23:28.002180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 328/646] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:27 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:28.243667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:28.244277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:28.250861 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.251315 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.252103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.252667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.388226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:28.395914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0cb2f540-3ce0-44bc-bf3f-c1da670c28e5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1555 microversion: 2.1 time: 0.156147 Jul 28 02:23:28.396483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 319/647] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:28 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:28.416963 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:28.417503 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:28.424614 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.425108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.425882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.426322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.505503 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d2449c6-500f-4f93-ae1e-0c958d5433d4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093299 Jul 28 02:23:28.506131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 329/648] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:23:28 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:28.531543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:28.532141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:28.538846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.539024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.539701 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:28.540238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:28.831852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:28.840285 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8d35fa93-a946-4ad1-b88c-4ec68ddf7912 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1724 microversion: 2.1 time: 0.312547 Jul 28 02:23:28.840868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 320/649] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:28 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:29.027993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:29.028627 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:29.041097 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:29.041708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:29.042772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:29.043304 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:29.270185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:29.280239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:29.281719 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:29.283533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-73376f16-a760-43cf-906b-6c5969ad1671 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.261939 Jul 28 02:23:29.284468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 330/650] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:29 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:29.703949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-6df576f9-ca84-4979-ae05-33610d6489ed req-2125a87c-86ed-426d-b9ad-e9c632d0ccb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3dc3c2-86d2-426f-826d-8ee87df1dbd9", "tag": "2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:29.716542 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6df576f9-ca84-4979-ae05-33610d6489ed req-2125a87c-86ed-426d-b9ad-e9c632d0ccb7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:29.717026 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6df576f9-ca84-4979-ae05-33610d6489ed req-2125a87c-86ed-426d-b9ad-e9c632d0ccb7 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:29.729930 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-6df576f9-ca84-4979-ae05-33610d6489ed req-2125a87c-86ed-426d-b9ad-e9c632d0ccb7 service nova] Creating event network-changed:2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1 for instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 on hv-cinder-79987 Jul 28 02:23:29.735431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-6df576f9-ca84-4979-ae05-33610d6489ed req-2125a87c-86ed-426d-b9ad-e9c632d0ccb7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Jul 28 02:23:29.736714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 321/651] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:23:29.863362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:29.863960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:29.870654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:29.871364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:29.872431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:29.872982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:30.025223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:30.034126 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-86b238d8-efa5-4dff-8463-957793dd3846 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1730 microversion: 2.1 time: 0.175352 Jul 28 02:23:30.034906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 331/652] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:29 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:30.056278 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:30.056779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:30.062951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:30.063638 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:30.065204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:30.065884 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:30.151112 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8ba383d4-6f69-402f-a228-c49f19d60a9a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099050 Jul 28 02:23:30.152500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 322/653] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:23:30 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:30.308193 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:30.308834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:30.318208 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:30.319420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:30.320456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:30.321147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:30.583320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:30.591815 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:30.593362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:30.594520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-345adaf5-5f03-47e2-b7bc-a268c37a1c67 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.291836 Jul 28 02:23:30.595079 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 332/654] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:30 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:31.618840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:31.619550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:31.626117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:31.626645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:31.627652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:31.628092 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:31.752388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}, {"name": "network-changed", "server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:31.763264 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:31.768164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:31.768608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:31.778437 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:31.780114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] Creating event network-changed:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:23:31.780267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:31.780616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] Creating event network-changed:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:23:31.781449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a99b166-7973-4333-a53e-81a417f534e0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.167089 Jul 28 02:23:31.782201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 323/655] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:31 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:31.786835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-d480d4ce-c5bf-46cb-b588-4c57fd4642ba req-ee3fa069-4b98-4ff9-8194-d4521aaf109b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038980 Jul 28 02:23:31.787600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 333/656] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:23:32.805513 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:32.806116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:32.812864 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:32.813337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:32.814770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:32.815199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:32.964087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:32.972865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:32.974398 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:32.975606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c4a15ab-6f96-47bb-80a2-b3ccc446fb40 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.174016 Jul 28 02:23:32.976171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 324/657] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:32 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:33.999972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:34.000669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:34.009064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:34.009520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:34.010300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:34.010735 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:34.147948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:34.156027 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:34.158082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:34.159382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-766fd661-8e70-4e13-a47a-907db7cd9348 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.164256 Jul 28 02:23:34.159946 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 334/658] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:33 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:35.182665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:35.183303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:35.190742 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:35.191195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:35.191956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:35.192391 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:35.326259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:35.337036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:35.338661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:35.339818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7ebb2e67-7c50-4c4e-8053-991d6fce5711 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1743 microversion: 2.20 time: 0.161075 Jul 28 02:23:35.340389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 325/659] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:35 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:36.365283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:36.365889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:36.372412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:36.372861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:36.373708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:36.374146 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:36.507218 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:36.515300 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:36.518596 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:36.520273 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f0dc36f3-6127-465c-a251-03667645fee0 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1743 microversion: 2.20 time: 0.158772 Jul 28 02:23:36.520612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 335/660] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:36 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:37.544359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:37.544997 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:37.555421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:37.555974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:37.556830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:37.557358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:37.753966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:37.764741 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:37.768866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:37.770138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9b44cbab-68b3-48a3-8a14-b391a95ca8f9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.230301 Jul 28 02:23:37.770713 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 326/661] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:37 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:38.796715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:38.797352 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:38.808017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:38.808468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:38.809291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:38.809744 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:38.972995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:38.994867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:38.996431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:38.997680 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a635a41a-c6fb-4c75-a745-18e1e73f3d21 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.204853 Jul 28 02:23:38.998241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 336/662] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:38 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:39.354352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-fff0ebdb-005e-4c44-9241-9e6cfff0e1a9 req-8eacd918-f906-48ba-9acb-4fc396b6dbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "name": "network-vif-plugged", "status": "completed", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:39.372693 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fff0ebdb-005e-4c44-9241-9e6cfff0e1a9 req-8eacd918-f906-48ba-9acb-4fc396b6dbb0 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:39.375244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fff0ebdb-005e-4c44-9241-9e6cfff0e1a9 req-8eacd918-f906-48ba-9acb-4fc396b6dbb0 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:39.390871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-fff0ebdb-005e-4c44-9241-9e6cfff0e1a9 req-8eacd918-f906-48ba-9acb-4fc396b6dbb0 service nova] Creating event network-vif-plugged:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:23:39.397004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-fff0ebdb-005e-4c44-9241-9e6cfff0e1a9 req-8eacd918-f906-48ba-9acb-4fc396b6dbb0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047143 Jul 28 02:23:39.398480 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 327/663] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:40.022641 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:40.023322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:40.033564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:40.034382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:40.035326 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:40.035758 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:40.217527 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:40.226593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:40.228181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:40.229478 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-94c65dfa-9fd0-4802-9eea-a3936ae80404 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.211886 Jul 28 02:23:40.230059 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 337/664] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:40 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:41.255551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:41.256376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:41.263858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:41.264910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:41.265712 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:41.266206 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:41.425846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:41.434952 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:41.436464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:41.437654 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2b1fb189-123d-40fd-bf7b-1730db0210a3 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.187306 Jul 28 02:23:41.448917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 328/665] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:41 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:42.461606 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:42.462208 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:42.469285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:42.469787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:42.471118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:42.471679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:42.628013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:42.637934 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:42.639901 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:42.641519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-107c40dd-e33d-4e0a-a4da-9502cec877a9 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.184000 Jul 28 02:23:42.643044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 338/666] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:42 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:43.671540 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:43.672225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:43.682657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:43.683219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:43.684069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:43.684578 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:43.839893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:43.849949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:43.851518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:43.852704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14393b09-2de7-4483-a678-7472a0215f65 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.185052 Jul 28 02:23:43.868910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 329/667] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:43 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:44.875855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:44.877414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:44.884180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:44.884701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:44.885583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:44.886101 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:45.038250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:45.046675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:45.048266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:45.049417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b775aadf-beed-49bb-8d1c-98e3de89f107 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.177805 Jul 28 02:23:45.050108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 339/668] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:44 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:46.075662 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:46.076227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:46.083552 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:46.083992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:46.084745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:46.085198 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:46.217646 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:46.227035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:46.228535 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:46.229707 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-297df2de-3c42-4754-b6a4-cb0f43196e13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1738 microversion: 2.20 time: 0.158033 Jul 28 02:23:46.230265 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 330/669] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:46 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:47.253258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:47.253866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:47.260445 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:47.260913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:47.261681 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:47.262118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:47.277395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:47.397246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:47.405107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:47.407143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:47.408347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee88b265-a670-43f3-9e8c-e0c4fbc02aec tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1720 microversion: 2.20 time: 0.159832 Jul 28 02:23:47.408914 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 340/670] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:47 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:48.436300 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:48.436839 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:48.443531 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:48.443984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:48.444749 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:48.445218 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:48.460424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:48.584426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:48.592172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:48.593728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:48.595826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-59d1e2a0-ccc2-44e4-bebf-3e4e00b03e05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1720 microversion: 2.20 time: 0.163118 Jul 28 02:23:48.596549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 331/671] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:48 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:49.619600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:49.620263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:49.627536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.627977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.628738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.629200 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.664789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:49.665405 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:49.672431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.673002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.673884 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.674333 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.700522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:23:49.760548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:49.770336 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:49.771922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:49.773493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26d5fa0d-ff59-40b0-9a39-a035ffa985bf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1663 microversion: 2.20 time: 0.157767 Jul 28 02:23:49.774050 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 341/672] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:49 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:49.794911 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2a8ecc7c-9132-4a63-b62d-2411ba3fee91 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 204 len: 0 microversion: 2.1 time: 0.133567 Jul 28 02:23:49.795640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 332/673] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:23:49 2022] DELETE /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 02:23:49.796797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "071c2bd3-05b7-43f6-9a54-6d88b6a0c092"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:49.799350 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:49.804865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:49.805576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:49.805681 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.806043 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.806818 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.807257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.816109 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.816573 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.817431 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:49.817867 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:49.963943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:49.972552 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0b9f21e3-701c-4717-babc-8324a3bb1872 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1576 microversion: 2.1 time: 0.172524 Jul 28 02:23:49.973170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 333/674] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:49 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:50.093293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aaa22a5a-3107-4f2e-94c5-32152d9f3456 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300575 Jul 28 02:23:50.093928 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 342/675] 10.222.0.40 () {62 vars in 1364 bytes} [Thu Jul 28 02:23:49 2022] POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 02:23:50.223846 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:50.224367 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:50.230457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.230908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.231670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.232104 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.483357 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7712a0be-e7f5-450b-bd75-ea2277eafa4e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments/071c2bd3-05b7-43f6-9a54-6d88b6a0c092" status: 202 len: 0 microversion: 2.20 time: 0.263887 Jul 28 02:23:50.484176 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 334/676] 10.222.0.40 () {60 vars in 1457 bytes} [Thu Jul 28 02:23:50 2022] DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments/071c2bd3-05b7-43f6-9a54-6d88b6a0c092 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:23:50.552283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:50.552860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:50.559260 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.559708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.560454 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.560907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.594211 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117787) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 02:23:50.661172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-49d2d59b-f9c1-487c-a49d-6f4e6825a509 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/action" status: 202 len: 0 microversion: 2.20 time: 0.112657 Jul 28 02:23:50.662110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 343/677] 10.222.0.40 () {62 vars in 1319 bytes} [Thu Jul 28 02:23:50 2022] POST /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:23:50.670647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:50.671831 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:50.679376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.679815 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.680574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:50.681055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:50.825200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:50.842492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:50.844228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:50.845866 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3ec41d32-76ea-438e-a7b0-c66a6da71e62 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1671 microversion: 2.20 time: 0.179415 Jul 28 02:23:50.846576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 335/678] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:50 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:50.996018 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:50.996739 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:51.005962 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:51.006787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:51.007977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:51.008860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:51.165491 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:51.175330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-22bac567-a223-4c2a-8f1d-f77c15a15d6a tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1576 microversion: 2.1 time: 0.183677 Jul 28 02:23:51.176088 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 344/679] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:50 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:51.401620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e7ba2e4a-f18f-4147-a680-9e19cba20225 req-6c149faf-08c3-44ac-9b7c-d7fe1133ca60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "name": "network-vif-unplugged", "status": "completed", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:51.413853 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e7ba2e4a-f18f-4147-a680-9e19cba20225 req-6c149faf-08c3-44ac-9b7c-d7fe1133ca60 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:51.414548 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e7ba2e4a-f18f-4147-a680-9e19cba20225 req-6c149faf-08c3-44ac-9b7c-d7fe1133ca60 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:51.428525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.compute.server_external_events [req-e7ba2e4a-f18f-4147-a680-9e19cba20225 req-6c149faf-08c3-44ac-9b7c-d7fe1133ca60 service nova] Unable to find a host for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f. Dropping event network-vif-unplugged {{(pid=117788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 02:23:51.429460 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e7ba2e4a-f18f-4147-a680-9e19cba20225 req-6c149faf-08c3-44ac-9b7c-d7fe1133ca60 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032028 Jul 28 02:23:51.430219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 336/680] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 02:23:51.870696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:51.871465 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:51.881751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:51.882296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:51.883150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:51.883951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:52.044167 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:52.054793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:52.056315 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:52.057821 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7515f817-6a19-4891-a5da-cf5b6fc21b30 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1671 microversion: 2.20 time: 0.191289 Jul 28 02:23:52.059044 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 345/681] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:51 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1671 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:52.198385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:52.199103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:52.206868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:52.207435 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:52.208289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:52.208801 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:52.273454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:52.281101 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa58d227-d839-4635-be44-4c7de52fb015 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 200 len: 1509 microversion: 2.1 time: 0.086817 Jul 28 02:23:52.282360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 337/682] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:52 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:52.552442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a2d13403-9cd8-45b4-b631-aa2a8c78e5fb req-8b6b33a7-60b4-49dd-ad77-28510888c5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e", "name": "network-vif-deleted", "tag": "d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:52.570075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a2d13403-9cd8-45b4-b631-aa2a8c78e5fb req-8b6b33a7-60b4-49dd-ad77-28510888c5fb service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:52.570793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a2d13403-9cd8-45b4-b631-aa2a8c78e5fb req-8b6b33a7-60b4-49dd-ad77-28510888c5fb service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:52.586005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a2d13403-9cd8-45b4-b631-aa2a8c78e5fb req-8b6b33a7-60b4-49dd-ad77-28510888c5fb service nova] Creating event network-vif-deleted:d7bdd3c4-419f-4c80-98bc-7d2cbf43e3df for instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e on hv-cinder-79987 Jul 28 02:23:52.592626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a2d13403-9cd8-45b4-b631-aa2a8c78e5fb req-8b6b33a7-60b4-49dd-ad77-28510888c5fb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140366 Jul 28 02:23:52.593909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 346/683] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:23:53.083361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:53.083878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:53.090630 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:53.090945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:53.092170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:53.092618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:53.292968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:53.306185 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:53.306838 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:53.315834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:53.316599 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:53.318039 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:53.318820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:53.320272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:53.323600 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:53.325245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-51ccf88f-9d91-47d2-822f-7446371daa04 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.247390 Jul 28 02:23:53.329951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 338/684] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:53 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:53.339484 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] HTTP exception thrown: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Request method failure captured: Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e HTTP/1.1 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fJOU0d1J8kf47DrlDP5X7PPqvY8jfBIiFctuSIfxG3Qxiet6m4MFVb_smQ33IZ0nSJOOBqr4eVcRI1_dHssNmR0Ivr1dtikoxvSJL-hZowRvD2lq4YMtZSZr8kSwQ7gawgA9ANFHbvZ-7zQ5KAV9kPZymocApQA_V10u00yUp1bhGc Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:23:53.341328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: dc1b1c277f9d4f9d8224a03201d3bb38 Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:23:53.342733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e'} Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:23:53.343569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:23:53.346401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:23:53.348704 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Returning 404 to user: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:23:53.350674 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-024b3b8f-d255-41ce-84a0-69e803f464a1 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 404 len: 111 microversion: 2.1 time: 0.042272 Jul 28 02:23:53.351302 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 347/685] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:53 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:23:53.463888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965690753", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-822063328", "security_groups": [{"name": "tempest-secgroup-smoke-115564651"}], "block_device_mapping_v2": [{"uuid": "63770741-866c-43e1-99d3-b8697562aac1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a862076-171d-4686-a6b7-e646e42fd313"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:53.591348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] validate_networks() for [('6a862076-171d-4686-a6b7-e646e42fd313', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:23:54.052495 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:23:54.052984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:23:54.053461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:23:54.053871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:23:54.054313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:23:54.064310 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:54.065457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:54.066424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:54.067796 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:54.088146 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:23:54.092632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for user dc1b1c277f9d4f9d8224a03201d3bb38 and project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:23:54.170747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:23:54.173800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63770741-866c-43e1-99d3-b8697562aac1',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:23:54.321056 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27f359b6-c20e-42e7-b2d1-807d497ed9c3 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860993 Jul 28 02:23:54.322779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 339/686] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:23:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:23:54.341608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c883c7cf-a76a-4798-856a-c5b9c333f01f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:54.343520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c883c7cf-a76a-4798-856a-c5b9c333f01f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:54.356177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:54.356799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:54.368105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:54.368714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:54.369534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:54.370160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:54.469563 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c883c7cf-a76a-4798-856a-c5b9c333f01f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:54.478383 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c883c7cf-a76a-4798-856a-c5b9c333f01f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1094 microversion: 2.1 time: 0.147642 Jul 28 02:23:54.478956 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 348/687] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:54 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1094 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:54.586605 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:54.601589 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:54.604948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:54.607756 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a79372b-b97e-47c5-a003-ecb6cfdd4dcf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.256300 Jul 28 02:23:54.610949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 340/688] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:54 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:55.499518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:55.500755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:55.508343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.508793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.509593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.510038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.580892 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:55.590216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6cb2c3f1-8603-41f5-89a4-8b966689b689 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.094781 Jul 28 02:23:55.590790 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 349/689] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:55 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:55.627297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:23:55.628523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:55.635449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.636138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.637294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.637893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.641460 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:55.642374 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:55.650875 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.651314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.652096 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.653071 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.668628 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lazy-loading 'flavor' on Instance uuid 734a7df7-1d42-44b2-a43e-f71f1811a773 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:23:55.780373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-40b1aacc-6490-4919-81b2-093ac687bb12 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "POST /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773/action" status: 202 len: 0 microversion: 2.1 time: 0.157463 Jul 28 02:23:55.781876 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 341/690] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:23:55 2022] POST /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:23:55.791448 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:55.792555 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:55.800280 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.801024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.801945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:55.802395 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:55.833740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:55.842433 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:55.844021 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:55.845697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f412b828-ef0c-4798-9940-96ad5b060e0e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.210001 Jul 28 02:23:55.857881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 350/691] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:55 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:23:55.966574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:55.975584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a92c5e48-fd74-4ed2-9df8-07c81e534bdd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.189160 Jul 28 02:23:55.976175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 342/692] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:55 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:56.612162 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:56.612768 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:56.620296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:56.620851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:56.621882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:56.622344 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:56.689276 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:56.698519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-66842fbf-067f-472f-8776-306d30f97ab7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.091402 Jul 28 02:23:56.699098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 351/693] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:56 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:56.874246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:56.875812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:56.878369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:56.884633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:56.885102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:56.885884 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:56.886329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:56.892364 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:56.998036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:56.998952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:57.007670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:57.008437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:57.009424 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:57.010011 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:57.049974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:57.059295 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:57.064670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:57.065977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a734ef1-add0-4dee-bbc9-f982bc8f192a tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.195699 Jul 28 02:23:57.080691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 343/694] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:56 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:57.173714 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:57.181566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4210f91e-3a93-42e5-b8cd-254d38ab0621 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.187402 Jul 28 02:23:57.182139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 352/695] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:56 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:57.723028 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:57.723732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:57.730320 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:57.730785 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:57.731557 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:57.731991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:57.795763 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:57.803651 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-89c496b6-0822-459c-ada3-18070d356c1d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.086440 Jul 28 02:23:57.810649 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 344/696] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:57 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:58.089765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:58.090522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:58.093046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:58.098515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.098970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.099746 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.100178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.205372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:58.206200 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:58.214620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.215446 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.216263 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.216745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.316585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:58.326883 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:58.329099 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:58.330652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ebcdf72f-185b-4b5a-8c55-a51d839f3960 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.244762 Jul 28 02:23:58.331229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 353/697] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:58 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:58.394868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:58.402891 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-43f046e2-fe0c-47d4-b93f-9e782d2dd63b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.203727 Jul 28 02:23:58.403478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 345/698] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:58 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:23:58.824129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:58.824822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:58.832104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.832555 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.833388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:58.833825 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:58.903435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:58.912588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1228816e-2e11-4a45-a1d3-ebd9dafcc38f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.092183 Jul 28 02:23:58.914005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 354/699] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:58 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:59.358943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:59.361223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:59.367975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.368427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:59.369236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.369674 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:59.428266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:59.429591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:59.436972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.438284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:59.439317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.440032 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:59.574515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:59.584259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:59.586031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:59.587426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-958ada27-72f8-48b8-a513-ea926ae42ebc tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.232451 Jul 28 02:23:59.600966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 346/700] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:23:59 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:23:59.627383 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:23:59.630796 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:23:59.640381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dec4a963-4b31-44e2-ac4f-01d86c0aadae tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.217647 Jul 28 02:23:59.654685 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 355/701] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:59 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:23:59.933718 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:23:59.934238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:23:59.942662 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.943110 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:23:59.943882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:23:59.944314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:00.011389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:00.019083 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c3ed85a-6462-4f74-ae53-9c5f740f6a2c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.089275 Jul 28 02:24:00.019663 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 347/702] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:23:59 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:00.615588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:00.616265 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:00.623673 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:00.624124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:00.624981 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:00.625524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:00.664553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:00.665249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:00.674758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:00.675555 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:00.676744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:00.677587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:00.833679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:00.855081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:00.856603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:00.857826 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-38c9272f-435f-4ca9-836d-02786f03ef86 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.248028 Jul 28 02:24:00.858768 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 356/703] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:00 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:00.866752 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:00.874505 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8d689209-7b5c-48ec-87d3-224b505b94d4 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.215653 Jul 28 02:24:00.875570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 348/704] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:00 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:01.040795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:01.041493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:01.049495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.049937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:01.050699 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.051125 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:01.124358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:01.132286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-63390c5e-77b6-423a-9e64-64b68ed61dc7 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.096516 Jul 28 02:24:01.132857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 357/705] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:01 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:01.887735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:01.888389 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:01.896359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.896742 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:01.897696 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.898135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:01.899528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:01.900780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:01.908042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.908860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:01.909923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:01.910578 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:02.104290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:02.112791 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:02.114335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:02.115511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1cc5f3ea-16d9-4c00-b6f3-26844c32dcd7 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.231913 Jul 28 02:24:02.116149 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 349/706] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:01 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:02.128332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:02.136121 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a01cc93-f784-4520-bcba-514fd82bb65c tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.242796 Jul 28 02:24:02.137373 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 358/707] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:01 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:02.152355 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:02.153289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:02.160951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:02.161382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:02.162150 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:02.162601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:02.230110 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:02.238944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-26489f04-6811-4e20-baf5-0b32145b831d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.090433 Jul 28 02:24:02.239534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 350/708] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:02 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:03.138100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:03.138828 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:03.146013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.146487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.147251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.147702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.162350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:03.162959 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:03.169508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.169956 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.170711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.171145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.337798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:03.346541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:03.348223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:03.349317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-322d213c-f8b4-4367-a64e-87a3a24b2c05 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.215255 Jul 28 02:24:03.361082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 359/709] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:03 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:03.361082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:03.361082 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:03.363240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:03.368111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.368571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.369377 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:03.369813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:03.370908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb86aef5-51f7-4739-b088-74e067b3550b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.212402 Jul 28 02:24:03.371482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 351/710] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:03 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:03.431395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:03.438900 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee174dab-c4c9-4751-94e3-4534bbb58e65 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1144 microversion: 2.1 time: 0.088075 Jul 28 02:24:03.439465 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 360/711] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:03 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:04.373797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:04.374413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:04.376803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:04.377473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:04.383850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.384291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.385155 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.385587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.393511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:04.394118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:04.400761 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.401251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.402017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.402472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.474468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:04.587960 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:04.599174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:04.601664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:04.603695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2c68263e-5c49-48db-b49c-848b54ecbcc6 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.233873 Jul 28 02:24:04.604752 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 352/712] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:04 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:04.612617 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:04.613445 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:04.613661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:04.622174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.623144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.624127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:04.624583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:04.626913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8edcc2a5-5a37-4ce5-a5ad-72ebd9c870fd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.237339 Jul 28 02:24:04.628386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 361/713] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:04 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:04.708259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:04.716498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fad29805-6b10-4b50-9030-810a5b4ee358 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1210 microversion: 2.1 time: 0.110444 Jul 28 02:24:04.717112 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 353/714] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:04 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:05.629325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:05.629945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:05.636517 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.637022 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.637927 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.638370 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.651567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:05.652992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:05.661466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.662169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.663349 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.663794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.869797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:05.877224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:05.879519 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:05.881199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:05.882876 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f1a7e4f6-595c-4ac8-8477-700469d22ab1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.257490 Jul 28 02:24:05.883527 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 362/715] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:05 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:24:05.893601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d6a7cdcc-83be-479d-b8ca-946c1594b233 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.238183 Jul 28 02:24:05.893601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 354/716] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:05 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:05.903399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:05.904331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:05.914597 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.915262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.916407 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.917088 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.970208 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:05.971003 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:05.978095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.978726 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:05.979651 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:05.980640 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:06.007840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8c63e50a-6081-4c64-9e59-773e0fd4eeca tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/ips" status: 200 len: 149 microversion: 2.1 time: 0.042514 Jul 28 02:24:06.008364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 363/717] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:24:05 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:24:06.014113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b3083f34-0ffb-40c8-8f22-4b019bef66d0 req-ee87e5cd-4593-4c40-845d-fab08aa5508b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1560ee-67e3-4c05-b0e3-e51772b3fad9", "tag": "b509a104-5aca-4c4b-b08e-13aca2f9bbe0"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:06.027157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b3083f34-0ffb-40c8-8f22-4b019bef66d0 req-ee87e5cd-4593-4c40-845d-fab08aa5508b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:06.027664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b3083f34-0ffb-40c8-8f22-4b019bef66d0 req-ee87e5cd-4593-4c40-845d-fab08aa5508b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:06.050008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b3083f34-0ffb-40c8-8f22-4b019bef66d0 req-ee87e5cd-4593-4c40-845d-fab08aa5508b service nova] Creating event network-changed:b509a104-5aca-4c4b-b08e-13aca2f9bbe0 for instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 on hv-cinder-79987 Jul 28 02:24:06.063776 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-b3083f34-0ffb-40c8-8f22-4b019bef66d0 req-ee87e5cd-4593-4c40-845d-fab08aa5508b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051809 Jul 28 02:24:06.064533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 364/718] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:06.145483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:06.159829 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0a84abce-0cf2-4b68-92bf-b7ca47220740 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.272325 Jul 28 02:24:06.169487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 355/719] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:05 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:06.907432 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:06.908096 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:06.908455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:06.908784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:06.914756 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:06.915174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:06.915294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:06.915627 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:06.915936 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:06.916370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:06.916487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:06.916817 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:07.068624 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:07.081106 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:07.082606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:07.084017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-02034e6d-c28a-4c36-bee4-9f43494b3784 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.180468 Jul 28 02:24:07.084573 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 356/720] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:06 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:07.181832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:07.182619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:07.190212 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:07.190665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:07.191728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:07.192541 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:07.227799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:07.235792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bf1e339c-9217-47b9-82ea-b694cf49ade2 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.331985 Jul 28 02:24:07.244543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 365/721] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:06 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:07.332829 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:07.341498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a7664f3c-77e6-49de-aca8-3e05cf14b174 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.163435 Jul 28 02:24:07.342399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 357/722] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:07 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:07.463893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f87891a-a1e6-40f2-a7bc-dec6f5ca8015"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:07.466487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:07.473937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:07.474448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:07.475312 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:07.475810 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:07.741064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4cfb6a14-3b05-4ec6-bca7-981a9f1b33e7 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "POST /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280946 Jul 28 02:24:07.741665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 366/723] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:24:07 2022] POST /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:08.107437 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:08.107981 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:08.114529 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.114978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.115741 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.116177 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.256900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:08.259593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:08.263857 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:08.270827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:08.271880 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.272373 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.273813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:08.273951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.273951 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.274143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5f320264-e1d1-4b4e-b7b8-0f055d1ef330 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.170597 Jul 28 02:24:08.288168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 358/724] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:08 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:08.364089 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:08.364793 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:08.370910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.371433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.372303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:08.372826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:08.423701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:08.431255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fe838942-b956-4742-b43b-5980724c7efe tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.176345 Jul 28 02:24:08.431812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 367/725] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:08 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:08.513485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:08.517711 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:08.522818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6fd9c64a-8963-4b1a-bf65-809f2dd1f4e9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.163329 Jul 28 02:24:08.523393 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 359/726] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:08 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:09.298904 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:09.299796 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:09.306468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.306913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.307671 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.308100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.455575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:09.457292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:09.461239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:09.472326 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.473180 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.473560 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:09.474544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.474994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.475131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:09.476267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-928d8c90-2b62-4349-8097-c98e8b186158 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.182108 Jul 28 02:24:09.488249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 368/727] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:09 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:09.508930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:09.509709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:09.521653 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.522201 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.523095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.523538 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.636390 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:09.637845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'services' on Instance uuid c55cbbcb-d9ea-4797-a39a-b663942e8ff6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:24:09.645378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-98c7ce56-26a9-4565-a3cb-13f0d6ada4ea tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.195562 Jul 28 02:24:09.646050 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 360/728] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:09 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:09.716257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-26e41302-3946-47e5-addb-c349ff980180 req-912f5d1c-deb6-454f-bb63-cdfcb0b0c152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "name": "network-vif-plugged", "status": "completed", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:09.717252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc390dbb-7759-498f-861f-c917aae6e8f2 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments/7bb21107-f7d9-42f4-bc3b-8d7d6bad271e" status: 202 len: 0 microversion: 2.1 time: 0.212035 Jul 28 02:24:09.719726 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 369/729] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:24:09 2022] DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments/7bb21107-f7d9-42f4-bc3b-8d7d6bad271e => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:24:09.726666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:09.727729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:09.728011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-26e41302-3946-47e5-addb-c349ff980180 req-912f5d1c-deb6-454f-bb63-cdfcb0b0c152 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.728343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-26e41302-3946-47e5-addb-c349ff980180 req-912f5d1c-deb6-454f-bb63-cdfcb0b0c152 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.734450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.734908 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.735690 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.736132 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.742016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-26e41302-3946-47e5-addb-c349ff980180 req-912f5d1c-deb6-454f-bb63-cdfcb0b0c152 service nova] Creating event network-vif-plugged:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:24:09.747483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-26e41302-3946-47e5-addb-c349ff980180 req-912f5d1c-deb6-454f-bb63-cdfcb0b0c152 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100054 Jul 28 02:24:09.748485 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 361/730] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:09.757978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:09.762124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:09.772966 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.773584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.774606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:09.775299 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:09.809499 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-40aa1437-d449-4d14-a54c-b5a1f9de5c4a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059033 Jul 28 02:24:09.810388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 362/731] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:09 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:09.895095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:09.902562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9ccc7ab3-460c-4821-9192-d4a8733f00d4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.181469 Jul 28 02:24:09.903122 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 370/732] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:09 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:10.091669 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.092186 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.098953 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.099406 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.100167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.100603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.181584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'services' on Instance uuid 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:24:10.295159 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-794d083d-3786-4e11-af8b-1b024ffd680d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments/9f87891a-a1e6-40f2-a7bc-dec6f5ca8015" status: 202 len: 0 microversion: 2.1 time: 0.207258 Jul 28 02:24:10.295779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 363/733] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:24:10 2022] DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments/9f87891a-a1e6-40f2-a7bc-dec6f5ca8015 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:24:10.304677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.306945 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.316380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.337840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.341816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.346127 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.362734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:10.382257 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-22b3c498-010f-4563-8d84-0733d70b92a5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081459 Jul 28 02:24:10.382829 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 371/734] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:10 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:10.501734 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.502366 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.508623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.509119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.509888 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.510325 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.642430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:10.650593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:10.652184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:10.653385 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4175b781-2cd4-4bd3-a802-6b4dc71dbf13 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.157824 Jul 28 02:24:10.653951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 364/735] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:10 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:10.668161 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.669007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.676525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.677018 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.677800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.678235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.811216 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:10.819565 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b39acab4-6754-4294-ade1-586fb76ceaee tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.155935 Jul 28 02:24:10.820128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 372/736] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:10 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:10.822964 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.825213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.831882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.832332 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.833132 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.833570 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.862113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7516570c-11f6-40c1-8a27-2517aab24a88 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Jul 28 02:24:10.862664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 365/737] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:10 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:24:10.923844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:10.924509 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:10.930441 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.930881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:10.931661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:10.932089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.071252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:11.079246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-491ac0d2-fb94-4d30-8b53-5d5f53cec77c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.159914 Jul 28 02:24:11.079819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 373/738] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:10 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:11.394977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:11.397133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:11.403362 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.403813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.404608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.405161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.438974 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14ff3beb-c02f-4396-9310-eb940dc1d7f3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048282 Jul 28 02:24:11.439549 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 366/739] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:11 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:11.677392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:11.677933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:11.683975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.684432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.685231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.685672 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.823491 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:11.832174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:11.833706 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:11.834886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ca83f31-d124-418f-910e-be4424ecb06e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.161527 Jul 28 02:24:11.835439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 374/740] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:11 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:11.841133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:11.841740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:11.849174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.849624 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.850384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.850818 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.874267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:11.876547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:11.882610 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.883052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.883808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:11.884238 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:11.914536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-23f9eb28-1740-4c77-8cd1-08ef85079c26 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044115 Jul 28 02:24:11.915077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 375/741] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:11 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 02:24:11.991842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:11.993667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:11.994202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:11.999556 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b21df89a-072b-4753-8fbd-61fc6032113d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.162038 Jul 28 02:24:12.000306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 367/742] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:11 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:12.001149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.001605 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.002678 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.002875 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.027718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:24:12.100507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.101163 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.107696 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.108290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.109207 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3a2e2e56-7cf0-4039-972a-00bce395575e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 204 len: 0 microversion: 2.1 time: 0.118886 Jul 28 02:24:12.109348 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.109691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.109802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 376/743] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:11 2022] DELETE /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 02:24:12.119885 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.120585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.127797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.128254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.129076 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.129518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.315424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:12.319539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:12.322904 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-574143cb-2879-433e-96f0-82f46c65d7fc tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.226743 Jul 28 02:24:12.323478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 368/744] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:12 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:12.327413 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc48672b-55bd-4b47-8579-29dddfd5e68a tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.213197 Jul 28 02:24:12.327983 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 377/745] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:12 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:12.451044 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.453774 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.460032 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.460475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.461258 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.461688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.492466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bd76a838-b92c-40b4-b88b-17f435952b98 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045257 Jul 28 02:24:12.493123 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 369/746] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:24:12 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:24:12.560804 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.561322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.569008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.569607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.570228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.570669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.598191 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:24:12.683251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-def08eea-fcbb-4357-9b7e-69e01600a79e tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 204 len: 0 microversion: 2.1 time: 0.126159 Jul 28 02:24:12.683943 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 378/747] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:12 2022] DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:24:12.692143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.692701 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.698840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.699368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.700135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.700595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.843438 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:12.852417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f2462da1-a154-4726-8647-1e2994a5ddee tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.164168 Jul 28 02:24:12.853215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 370/748] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:12 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:12.860144 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:12.861074 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:12.868390 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.869025 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:12.869872 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:12.870393 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.005720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.014541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.016950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.019305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57293bf5-659c-406f-93b0-637a7b4d2ae1 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1729 microversion: 2.20 time: 0.163636 Jul 28 02:24:13.020100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 379/749] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:12 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 02:24:13.025573 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:13.026287 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:13.033250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.033842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.034694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.035206 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.176023 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.183418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c4dd98e9-6367-43a6-a2a3-de1bf910e093 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.165762 Jul 28 02:24:13.183991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 371/750] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:13 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:13.344561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:13.345194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:13.348280 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:13.349047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:13.352509 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.352991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.353749 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.354177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.355604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.356058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.356825 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.357285 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.552347 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.555129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:13.560388 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e2f571b8-9b24-4b9d-a6bc-02e710113946 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.220626 Jul 28 02:24:13.560898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 380/751] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:13 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:13.563405 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fc8dd696-f19a-4d70-9625-185fea23e3e1 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.219339 Jul 28 02:24:13.564093 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 372/752] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:13 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:13.874103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:13.874642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:13.881195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.881634 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:13.882383 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:13.882812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.010332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.018389 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fdf2b9ff-b333-416f-b63a-8cded97a5ad5 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.148239 Jul 28 02:24:14.018953 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 381/753] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:13 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:14.042968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:14.043660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:14.051091 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.051544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.052308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.052748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.184374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.192350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.193941 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.195097 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0aace54c-1f49-480d-bc7a-ff59ac5bdabf tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1716 microversion: 2.20 time: 0.156141 Jul 28 02:24:14.195668 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 373/754] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:14 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:14.205374 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:14.206446 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:14.212591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.213104 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.213881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.214316 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.343219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.351604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e8eb887c-66b5-4598-b0fa-176de89d6824 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.150769 Jul 28 02:24:14.352176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 382/755] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:14 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:14.581760 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:14.582380 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:14.584234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:14.585045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:14.588576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.589063 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.589842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.590277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.591029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.591474 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.592258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:14.592687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:14.792035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.799595 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:14.800542 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-48fa0aec-319c-43b7-99fd-e3aea4f6e7db tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.223404 Jul 28 02:24:14.801166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 374/756] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:14 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:14.807308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e5dac626-c7df-41d6-940c-d29321c0fae8 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.227199 Jul 28 02:24:14.807853 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 383/757] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:14 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:15.040984 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:15.041596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:15.050475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.051065 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.051691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.052126 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.179453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:15.186855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-538a96e0-b3d6-4d30-bd4b-a2a13b94e297 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.149773 Jul 28 02:24:15.187591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 375/758] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:15 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:15.372822 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:15.373427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:15.381226 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.381439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.382285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.382779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.522238 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:15.524581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:15.531804 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-40500922-090e-4838-bc76-cc5b96a40d6a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.162219 Jul 28 02:24:15.532751 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 384/759] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:15 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:15.822921 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:15.823525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:15.829530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:15.830076 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:15.832309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.832714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.833515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.833986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.837636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.838084 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.838849 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:15.839280 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:15.853986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:16.050427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:16.054727 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:16.059164 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e92575a2-fb3c-4dd1-b50c-ca3159f73e5d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.240051 Jul 28 02:24:16.060363 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 376/760] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:15 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:16.068133 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-242ee23a-2801-49c9-abaf-d97b3904ddd0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.243366 Jul 28 02:24:16.069175 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 385/761] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:15 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:16.208290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:16.208822 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:16.214858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:16.215310 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:16.216075 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:16.216510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:16.344788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:16.352310 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c5fee5cf-1784-494f-acd0-1cc8d1821242 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.147888 Jul 28 02:24:16.352990 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 377/762] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:16 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:16.553735 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:16.554513 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:16.560851 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:16.561333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:16.562089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:16.562728 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:16.698141 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:16.705698 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ae01624-8c30-47d8-a795-ee3f47021cb0 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.155928 Jul 28 02:24:16.706263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 386/763] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:16 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:17.081413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:17.082270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:17.088758 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.089240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.089972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:17.090104 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.090475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.090618 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:17.097663 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.098106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.098861 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.099291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.286580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:17.290537 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:17.294105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-af709f66-93bf-47c4-95c4-958d719451cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.217287 Jul 28 02:24:17.294672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 378/764] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:17 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:17.298331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c19ec188-613a-4d66-87f6-ee3ec3122090 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.212113 Jul 28 02:24:17.298905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 387/765] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:17 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:17.374052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:17.376600 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:17.382499 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.382696 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.383493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.384116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.520723 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:17.528682 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f67a235b-f8cd-477d-bbdf-65743196c2a6 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.158460 Jul 28 02:24:17.538671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 379/766] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:17 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:17.560078 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-cfd4b9de-d298-4e22-a01f-f0ce12721b48 req-780d0802-deb9-45f0-805c-11b5c10a2ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1560ee-67e3-4c05-b0e3-e51772b3fad9", "name": "network-vif-plugged", "status": "completed", "tag": "b509a104-5aca-4c4b-b08e-13aca2f9bbe0"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:17.573064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cfd4b9de-d298-4e22-a01f-f0ce12721b48 req-780d0802-deb9-45f0-805c-11b5c10a2ab2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.574558 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-cfd4b9de-d298-4e22-a01f-f0ce12721b48 req-780d0802-deb9-45f0-805c-11b5c10a2ab2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.588652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-cfd4b9de-d298-4e22-a01f-f0ce12721b48 req-780d0802-deb9-45f0-805c-11b5c10a2ab2 service nova] Creating event network-vif-plugged:b509a104-5aca-4c4b-b08e-13aca2f9bbe0 for instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 on hv-cinder-79987 Jul 28 02:24:17.595081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-cfd4b9de-d298-4e22-a01f-f0ce12721b48 req-780d0802-deb9-45f0-805c-11b5c10a2ab2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039245 Jul 28 02:24:17.596010 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 388/767] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:17.727394 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:17.727997 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:17.736991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.737453 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:17.741543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:17.741543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.316767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:18.317845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:18.324252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.324783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.325668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.326319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.391343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:18.399593 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-60460fe0-a0a7-48ac-94c7-d9ed86aba5cd tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.675849 Jul 28 02:24:18.413406 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 380/768] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:17 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:18.418284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:18.419002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:18.432601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.432601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.432601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.432601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.648648 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:18.657100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9a6468a2-e920-49f6-879e-2a10631bf3c9 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.345711 Jul 28 02:24:18.670482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 389/769] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:18 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:18.682803 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:18.684131 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:18.690442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.691249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.692110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.692612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.724068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:18.731946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a82ea36-3ed7-4fa6-b1aa-a316a2de37ce tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1690 microversion: 2.1 time: 0.317401 Jul 28 02:24:18.747110 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 381/770] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:18 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1690 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:18.876133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-f1a5f457-7056-4267-ae70-2560884adf81 req-efee4f03-2f31-453d-b061-13479663afca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c55cbbcb-d9ea-4797-a39a-b663942e8ff6", "name": "network-vif-deleted", "tag": "4d95fa12-8f07-4a72-acd9-94e8934faa9a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:18.891126 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f1a5f457-7056-4267-ae70-2560884adf81 req-efee4f03-2f31-453d-b061-13479663afca service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:18.891602 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f1a5f457-7056-4267-ae70-2560884adf81 req-efee4f03-2f31-453d-b061-13479663afca service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:18.904042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-f1a5f457-7056-4267-ae70-2560884adf81 req-efee4f03-2f31-453d-b061-13479663afca service nova] Creating event network-vif-deleted:4d95fa12-8f07-4a72-acd9-94e8934faa9a for instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 on hv-cinder-79987 Jul 28 02:24:18.919012 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:18.920947 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-f1a5f457-7056-4267-ae70-2560884adf81 req-efee4f03-2f31-453d-b061-13479663afca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051189 Jul 28 02:24:18.929041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 382/771] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:18.935009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-35cce27c-249a-43c9-a5f0-34a7b235f302 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1679 microversion: 2.1 time: 0.262693 Jul 28 02:24:18.958702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 390/772] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:18 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1679 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:19.311589 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e83f04ed-cdf1-4c22-9780-7fa91ae9fe19 req-2ad85d33-f2e9-48ed-87c4-ab4533ed3e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3dc3c2-86d2-426f-826d-8ee87df1dbd9", "name": "network-vif-deleted", "tag": "2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:19.322030 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e83f04ed-cdf1-4c22-9780-7fa91ae9fe19 req-2ad85d33-f2e9-48ed-87c4-ab4533ed3e4e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.322825 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e83f04ed-cdf1-4c22-9780-7fa91ae9fe19 req-2ad85d33-f2e9-48ed-87c4-ab4533ed3e4e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.335303 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e83f04ed-cdf1-4c22-9780-7fa91ae9fe19 req-2ad85d33-f2e9-48ed-87c4-ab4533ed3e4e service nova] Creating event network-vif-deleted:2335b22e-3eb0-4fc9-ab8b-b7fd4ea5e4b1 for instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 on hv-cinder-79987 Jul 28 02:24:19.340716 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e83f04ed-cdf1-4c22-9780-7fa91ae9fe19 req-2ad85d33-f2e9-48ed-87c4-ab4533ed3e4e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098049 Jul 28 02:24:19.341910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 383/773] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:19.424115 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:19.425150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:19.431755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.432562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.433659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.434320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.583494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:19.591591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0b3e7923-5ac1-4223-9895-ca778973fe6b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.172168 Jul 28 02:24:19.592172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 391/774] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:19 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:19.678610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:19.679915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:19.686313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.687700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.689082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.689511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.759598 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:19.760538 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:19.779571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.780385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.781800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.782664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.871962 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:19.886581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9861d3a7-bd32-4320-942b-31855314675d tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1622 microversion: 2.1 time: 0.135489 Jul 28 02:24:19.887548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 392/775] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:19 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1622 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:19.901383 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:19.910030 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ea059257-ef22-4e24-93d3-2bb1acff917c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1265 microversion: 2.1 time: 0.235576 Jul 28 02:24:19.910613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 384/776] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:19 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:19.959780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:19.960612 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:19.966676 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.967134 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:19.967905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:19.969242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.045361 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:20.054231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d69ee892-a203-437c-8c58-ef09cc6fac61 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1326 microversion: 2.1 time: 0.098197 Jul 28 02:24:20.055098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 393/777] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:19 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:20.613571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:20.614126 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:20.620664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.621150 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.621908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.622343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.759049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:20.768167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6eafca0c-9ddf-45d3-835c-e408ade00d35 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.158880 Jul 28 02:24:20.768749 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 385/778] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:20 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:20.907831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:20.908642 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:20.915045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.915490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.916306 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.916741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.930925 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:20.931652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:20.938705 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.938705 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.939704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.940139 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.950230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:20.950678 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:20.951120 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'fault' on Instance uuid c55cbbcb-d9ea-4797-a39a-b663942e8ff6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:24:21.001747 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:21.009163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b10f6cbe-6ef3-4216-a369-aa69dc5771e4 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 200 len: 1334 microversion: 2.1 time: 0.105350 Jul 28 02:24:21.009733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 394/779] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:20 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:21.075858 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:21.076617 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:21.083278 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.084057 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.084936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.085443 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.105842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:21.114375 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d315dd1f-8e38-4424-9b8e-c4122d920179 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1452 microversion: 2.1 time: 0.187171 Jul 28 02:24:21.114894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:21.115675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 386/780] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:20 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:21.119029 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.119484 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.119941 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lazy-loading 'fault' on Instance uuid 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:24:21.135052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:21.135691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:21.142800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.143254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.144035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.144469 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.164332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5032b52a39454e91d7154b36f85894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4622eae14dd460dbd4e51d4a0413e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:21.173048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6554ac32-c186-474c-9395-56ee4361e23f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 200 len: 1331 microversion: 2.1 time: 0.101115 Jul 28 02:24:21.173641 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 395/781] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:21 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:21.288193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:21.295859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d10a5b2f-b560-4c13-b917-43daf66580cd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1452 microversion: 2.1 time: 0.164578 Jul 28 02:24:21.298053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 387/782] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:21 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:21.792291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:21.793145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:21.801950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.802548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.803436 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.803988 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.945108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:21.953427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0a3b1e89-88c5-4571-8a24-656de7a1eb7d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1508 microversion: 2.1 time: 0.165079 Jul 28 02:24:21.954092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 396/783] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:21 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:21.976058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:21.976754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:21.982913 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.983369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:21.984115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:21.984638 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.030230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117788) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 02:24:22.034979 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:22.035815 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: c55cbbcb-d9ea-4797-a39a-b663942e8ff6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:22.042576 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.043259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.044151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.044907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.062052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] HTTP exception thrown: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Request method failure captured: Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 HTTP/1.1 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fI4YAiSBti0RGiamXJLr054Mccmo8rvde74uwjbQj0UtXB7BOuTcPsV4Bb9rWvj09egroTr6tu_RM6MWvtSlPWQP5ZtWXS8wTkrpo5ANOwpnyuyMXk7bGYvEqmPWkn6wCUkTS-5qVTh8T8iTjyMtRSbIVt0jdrHDfkdolNqTT8IX30 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:22.063997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5157a5b7f25482980f925175adf2090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5157a5b7f25482980f925175adf2090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 50a2f75083ec40f3a6254c25b57862ae Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. Jul 28 02:24:22.065422 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'c55cbbcb-d9ea-4797-a39a-b663942e8ff6'} Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:22.066212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. Jul 28 02:24:22.067464 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.068594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Returning 404 to user: Instance c55cbbcb-d9ea-4797-a39a-b663942e8ff6 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:22.068594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5666bffa-c529-42c1-b3a4-39ba6c9d10f3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6" status: 404 len: 111 microversion: 2.1 time: 0.035067 Jul 28 02:24:22.068594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 397/784] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:22 2022] GET /compute/v2.1/servers/c55cbbcb-d9ea-4797-a39a-b663942e8ff6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:24:22.073982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-15856e22-f71e-4836-82b8-f05a41bca59e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '.version_select at 0x7efc52cc5160>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:22.101663 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-15856e22-f71e-4836-82b8-f05a41bca59e tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460012602" status: 202 len: 0 microversion: 2.1 time: 0.031292 Jul 28 02:24:22.102569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 398/785] 10.222.0.40 () {58 vars in 1218 bytes} [Thu Jul 28 02:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460012602 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:24:22.126787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-01158c5b-c53f-458b-ba93-45431c02c51d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "POST /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773/action" status: 202 len: 0 microversion: 2.1 time: 0.156479 Jul 28 02:24:22.127500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 388/786] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:24:21 2022] POST /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:24:22.135611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:22.136395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:22.150757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.151360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.152280 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.152832 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.194743 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:22.195835 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:22.203187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.203906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.204755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:22.205568 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:22.224928 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 HTTP/1.1 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:22.226894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:22.228488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '6a3dc3c2-86d2-426f-826d-8ee87df1dbd9'} Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:22.229523 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:22.230949 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:22.232223 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:22.233185 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8261cbd7-f330-43d6-b4ec-99c920e5cfed tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 404 len: 111 microversion: 2.1 time: 0.042499 Jul 28 02:24:22.239219 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 389/787] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:22 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:22.245159 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b3eaa458-2559-4385-bfde-e477f4f4351d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '.version_select at 0x7efc52d1fee0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:22.256313 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:22.275012 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b3eaa458-2559-4385-bfde-e477f4f4351d tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780997462" status: 202 len: 0 microversion: 2.1 time: 0.033560 Jul 28 02:24:22.275606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 390/788] 10.222.0.40 () {58 vars in 1218 bytes} [Thu Jul 28 02:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780997462 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:24:22.330509 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:22.338794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bb4a23fe-463e-4feb-b3cf-9b24555ed84d tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1516 microversion: 2.1 time: 0.207135 Jul 28 02:24:22.339732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 399/789] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:22 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:23.363430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:23.364948 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:23.374096 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:23.375112 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:23.376049 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:23.376686 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:23.560840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:23.569575 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-258a6be4-7f3d-4913-a5ef-a77638ca39bb tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1518 microversion: 2.1 time: 0.211944 Jul 28 02:24:23.570218 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 391/790] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:23 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:23.972616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c6e9d9fe-6297-4aca-817e-280b03fad70f req-c39e115b-8ead-427c-b89c-ac205e288d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1560ee-67e3-4c05-b0e3-e51772b3fad9", "tag": "b509a104-5aca-4c4b-b08e-13aca2f9bbe0"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:23.985429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c6e9d9fe-6297-4aca-817e-280b03fad70f req-c39e115b-8ead-427c-b89c-ac205e288d03 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:23.986579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c6e9d9fe-6297-4aca-817e-280b03fad70f req-c39e115b-8ead-427c-b89c-ac205e288d03 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:23.997700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c6e9d9fe-6297-4aca-817e-280b03fad70f req-c39e115b-8ead-427c-b89c-ac205e288d03 service nova] Creating event network-changed:b509a104-5aca-4c4b-b08e-13aca2f9bbe0 for instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 on hv-cinder-79987 Jul 28 02:24:24.003984 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c6e9d9fe-6297-4aca-817e-280b03fad70f req-c39e115b-8ead-427c-b89c-ac205e288d03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036007 Jul 28 02:24:24.005358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 400/791] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:24.163066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:24.163803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:24.172854 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.174016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.175702 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.176302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.194321 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 HTTP/1.1 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:24.196082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.197690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '6a3dc3c2-86d2-426f-826d-8ee87df1dbd9'} Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:24.198641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.200144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.201492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:24.201492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a966bea9-7895-4d78-9822-b3928deaca63 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 404 len: 111 microversion: 2.1 time: 0.043877 Jul 28 02:24:24.201492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 392/792] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:24 2022] DELETE /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:24.210434 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:24.211027 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:24.217741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.218426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.219473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.219919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.234491 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 HTTP/1.1 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:24.236181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.237812 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '6a3dc3c2-86d2-426f-826d-8ee87df1dbd9'} Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:24.238530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. Jul 28 02:24:24.239906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:24.241137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:24.241137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4e4d916e-0da9-4114-9300-2bb158aeb9c0 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9" status: 404 len: 111 microversion: 2.1 time: 0.031516 Jul 28 02:24:24.241137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 401/793] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:24 2022] GET /compute/v2.1/servers/6a3dc3c2-86d2-426f-826d-8ee87df1dbd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:24.591323 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:24.591940 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:24.600253 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.601488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.605960 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:24.607968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:24.811360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:24.819893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a7ccf2d-7917-4330-883e-3fdc95a139f1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.232350 Jul 28 02:24:24.820623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 393/794] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:24 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:25.404456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.404994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.411992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.412440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.413237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.413673 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.427631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 HTTP/1.1 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:25.429195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.430764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'd907d04a-4c0b-4e3c-a7df-a3eeb192a2b6'} Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:25.431795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.433271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.434923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:25.434923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-84d8ff34-0a7a-4185-8d0a-2ba46533ba47 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 404 len: 111 microversion: 2.1 time: 0.029976 Jul 28 02:24:25.434923 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 402/795] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:25 2022] DELETE /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:25.439804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.440415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.447220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.447667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.448458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.448939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.462724 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 HTTP/1.1 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:25.464235 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.465681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': 'd907d04a-4c0b-4e3c-a7df-a3eeb192a2b6'} Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:25.466421 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. Jul 28 02:24:25.467576 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.469356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:25.469356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-55319f8e-fdcf-4b27-82b9-225f28d02a55 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jul 28 02:24:25.469356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 394/796] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:25 2022] GET /compute/v2.1/servers/d907d04a-4c0b-4e3c-a7df-a3eeb192a2b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:24:25.474867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.475380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.481698 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.482146 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.482909 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.483863 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.497611 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 HTTP/1.1 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:25.499783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.502235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '606c5aa8-a5d8-4890-b67f-5be4476fea19'} Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:25.503202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.504759 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.506461 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:25.506461 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-813a8344-bdfa-4752-bdc6-03de76ecd226 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 404 len: 111 microversion: 2.1 time: 0.030224 Jul 28 02:24:25.506461 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 403/797] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:25 2022] DELETE /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:24:25.510994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.511620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 606c5aa8-a5d8-4890-b67f-5be4476fea19] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.517944 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.518331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.519087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.519517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.533609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 HTTP/1.1 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:25.535124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.536545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '606c5aa8-a5d8-4890-b67f-5be4476fea19'} Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:25.537314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. Jul 28 02:24:25.538475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:25.539508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 606c5aa8-a5d8-4890-b67f-5be4476fea19 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:25.539508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef39d05a-0c06-427c-8529-7ea9b24997c4 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19" status: 404 len: 111 microversion: 2.1 time: 0.029463 Jul 28 02:24:25.539508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 395/798] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:25 2022] GET /compute/v2.1/servers/606c5aa8-a5d8-4890-b67f-5be4476fea19 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:25.570439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-82373200-493f-44fc-b2f6-a7456104455d req-be15fc01-7110-446f-8849-2ac8355a6be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "name": "network-vif-unplugged", "status": "completed", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:25.581687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-82373200-493f-44fc-b2f6-a7456104455d req-be15fc01-7110-446f-8849-2ac8355a6be6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.582472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-82373200-493f-44fc-b2f6-a7456104455d req-be15fc01-7110-446f-8849-2ac8355a6be6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.598870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-82373200-493f-44fc-b2f6-a7456104455d req-be15fc01-7110-446f-8849-2ac8355a6be6 service nova] Creating event network-vif-unplugged:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:24:25.606390 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-82373200-493f-44fc-b2f6-a7456104455d req-be15fc01-7110-446f-8849-2ac8355a6be6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039495 Jul 28 02:24:25.607068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 404/799] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:24:25.774516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.775036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.781972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.782441 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.783268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.783698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.812408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:24:25.826226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:25.843639 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.845255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.852035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.852536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.853359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.853833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.897197 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5f3fc10-618f-41e0-bf2f-aa1852e3ed14 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 204 len: 0 microversion: 2.1 time: 0.126827 Jul 28 02:24:25.897822 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 396/800] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:25 2022] DELETE /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:24:25.908759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:25.909496 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:25.916458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.916939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:25.917698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:25.918128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:26.057077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:26.066359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36b03667-a63a-41d4-b08b-9455b8266bcf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.227551 Jul 28 02:24:26.066950 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 405/801] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:25 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:26.089781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:26.098361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1010e8ce-b1c2-4893-9233-2b7e4b037767 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1509 microversion: 2.1 time: 0.194462 Jul 28 02:24:26.098926 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 397/802] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:25 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:26.685075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:26.685569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:26.692906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:26.693367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:26.694140 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:26.694577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:26.707947 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c HTTP/1.1 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:26.709636 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.711150 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '4d26f3b8-4d46-47fe-84fe-f242e97a778c'} Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:26.712031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.713236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.714419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:26.714419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d885acba-59c1-46ea-b448-7a0727b403d3 tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 404 len: 111 microversion: 2.1 time: 0.029857 Jul 28 02:24:26.714419 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 406/803] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:26 2022] DELETE /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:26.719945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:26.720559 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] [instance: 4d26f3b8-4d46-47fe-84fe-f242e97a778c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:26.726622 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:26.727072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:26.727896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:26.728336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:26.742144 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] HTTP exception thrown: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Request method failure captured: Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c HTTP/1.1 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHojWPb7kUM2sdFoCsdSWuNFvAR70vNMyVnvb9Il9PV60XTsjEIVHI93SpqPjXV3M3cSAHQKYho2XuSDvY7FUoHEiqJAU9UqPv1uGlZwjw3E_jwq6MuW9mFPl6gdkz2lxPP9mdCyiX4-P2iSVRRnurRiS79TCoS0j9z-s5ywOHorL8 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:26.743780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4622eae14dd460dbd4e51d4a0413e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: f4622eae14dd460dbd4e51d4a0413e5f Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071307429 Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 4b5032b52a39454e91d7154b36f85894 Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-1071307429-project Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.745388 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '4d26f3b8-4d46-47fe-84fe-f242e97a778c'} Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:26.746317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. Jul 28 02:24:26.747779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:26.749697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] Returning 404 to user: Instance 4d26f3b8-4d46-47fe-84fe-f242e97a778c could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:26.749697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e3e7e075-59ca-4750-a621-dccab1b1262f tempest-AttachVolumeNegativeTest-1071307429 tempest-AttachVolumeNegativeTest-1071307429-project] 10.222.0.40 "GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c" status: 404 len: 111 microversion: 2.1 time: 0.029431 Jul 28 02:24:26.749697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 398/804] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:26 2022] GET /compute/v2.1/servers/4d26f3b8-4d46-47fe-84fe-f242e97a778c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:27.088275 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:27.088900 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:27.096358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:27.096819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:27.097618 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:27.098055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:27.100905 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:27.118898 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:27.119512 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:27.126323 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:27.127105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:27.127920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:27.128354 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:27.323482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:27.332468 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dc0901a9-9135-472c-85d5-27586fc12ab3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1509 microversion: 2.1 time: 0.217418 Jul 28 02:24:27.333094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 399/805] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:27 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:27.360965 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:27.370051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce10d4a7-3f84-4cfb-be73-eb35df45f736 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.285558 Jul 28 02:24:27.370986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 407/806] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:27 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:28.353931 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:28.354474 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:28.361676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:28.362129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:28.362902 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:28.363336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:28.391666 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:28.392274 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:28.400586 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:28.401130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:28.402047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:28.402705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:28.557335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:28.567008 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8e0c6e42-440b-43dd-80e3-779709d6be76 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 200 len: 1509 microversion: 2.1 time: 0.217025 Jul 28 02:24:28.573733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 400/807] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:28 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:28.582870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:28.590709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bd0fd9f9-85a4-4114-85dc-3cdbb9524357 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.203096 Jul 28 02:24:28.591281 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 408/808] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:28 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:28.993434 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e6a50479-7dc6-44cd-870d-8bbde5324ad4 req-ba437f96-af89-40fc-9803-875407815479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839bec7e-f188-482a-83c1-93f7812f1fb6", "name": "network-vif-deleted", "tag": "381df188-01c4-4181-92e1-f3df290d4f58"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:29.024585 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e6a50479-7dc6-44cd-870d-8bbde5324ad4 req-ba437f96-af89-40fc-9803-875407815479 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.025498 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e6a50479-7dc6-44cd-870d-8bbde5324ad4 req-ba437f96-af89-40fc-9803-875407815479 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.048559 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e6a50479-7dc6-44cd-870d-8bbde5324ad4 req-ba437f96-af89-40fc-9803-875407815479 service nova] Creating event network-vif-deleted:381df188-01c4-4181-92e1-f3df290d4f58 for instance 839bec7e-f188-482a-83c1-93f7812f1fb6 on hv-cinder-79987 Jul 28 02:24:29.059500 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e6a50479-7dc6-44cd-870d-8bbde5324ad4 req-ba437f96-af89-40fc-9803-875407815479 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070240 Jul 28 02:24:29.060464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 401/809] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:29.588833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:29.589492 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 839bec7e-f188-482a-83c1-93f7812f1fb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:29.598317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.598770 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.599581 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.600025 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.612606 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:29.613336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:29.615504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] HTTP exception thrown: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Request method failure captured: Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 HTTP/1.1 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fI4YAiSBti0RGiamXJLr054Mccmo8rvde74uwjbQj0UtXB7BOuTcPsV4Bb9rWvj09egroTr6tu_RM6MWvtSlPWQP5ZtWXS8wTkrpo5ANOwpnyuyMXk7bGYvEqmPWkn6wCUkTS-5qVTh8T8iTjyMtRSbIVt0jdrHDfkdolNqTT8IX30 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:29.617172 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5157a5b7f25482980f925175adf2090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5157a5b7f25482980f925175adf2090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 50a2f75083ec40f3a6254c25b57862ae Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. Jul 28 02:24:29.618738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '839bec7e-f188-482a-83c1-93f7812f1fb6'} Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:29.619696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. Jul 28 02:24:29.621157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:29.622492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.622492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.622492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.622816 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.623541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Returning 404 to user: Instance 839bec7e-f188-482a-83c1-93f7812f1fb6 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:29.625696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7eca0e41-8a49-49ab-b278-6d2a0ac52e94 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6" status: 404 len: 111 microversion: 2.1 time: 0.041477 Jul 28 02:24:29.626271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 409/810] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:29 2022] GET /compute/v2.1/servers/839bec7e-f188-482a-83c1-93f7812f1fb6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:29.634928 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:29.635425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:29.642847 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.643297 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.644106 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.644541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.672516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:24:29.754448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b8a5b6e1-a8c2-40a9-b11f-73372b161de0 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "DELETE /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 204 len: 0 microversion: 2.1 time: 0.123066 Jul 28 02:24:29.755110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 410/811] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:24:29 2022] DELETE /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 02:24:29.763711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:29.765360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:29.772066 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.772522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:29.773364 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:29.773814 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:30.193358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:30.200502 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:30.201213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-94b7dc59-8141-4350-b82b-59314d5f7c83 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.593245 Jul 28 02:24:30.201965 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 402/812] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:29 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:30.208716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d1c6ebed-9427-4298-a8d6-8c62715cfe49 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.449218 Jul 28 02:24:30.209493 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 411/813] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:29 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:31.225232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:31.225848 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:31.230376 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:31.231228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:31.232481 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:31.232989 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:31.234559 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:31.235148 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:31.238092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:31.238551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:31.239499 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:31.240124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:31.450536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:31.459467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-53dcce51-c5dc-403d-96bf-c497fccca4e1 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.238266 Jul 28 02:24:31.460400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 403/814] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:31 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:31.468546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:31.476895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-de505586-74a3-4767-8fd9-563f228cc502 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.250896 Jul 28 02:24:31.477529 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 412/815] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:31 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:32.169149 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf5401b7-fe7e-451a-9906-fd9c1ea8f3b9 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Action: 'create', calling method: .version_select at 0x7efc52dcae50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2072524334", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:32.456124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cf5401b7-fe7e-451a-9906-fd9c1ea8f3b9 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.402449 Jul 28 02:24:32.456858 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 404/816] 10.222.0.40 () {60 vars in 1156 bytes} [Thu Jul 28 02:24:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 02:24:32.469782 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ed51453c-41d1-4c15-afe7-789ac4f4515f tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52cdd4c0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:32.485218 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:32.485837 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:32.493138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:32.494809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:32.495781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:32.496374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:32.522683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ed51453c-41d1-4c15-afe7-789ac4f4515f tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 200 len: 353 microversion: 2.1 time: 0.056916 Jul 28 02:24:32.523346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 413/817] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:32 2022] GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:32.528995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:32.529831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:32.537658 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:32.538219 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:32.539165 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:32.539786 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:32.694222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:32.704361 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d6545f8d-4059-473e-a9de-a221ea494a85 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.226977 Jul 28 02:24:32.705228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 405/818] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:32 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:32.718463 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:32.727239 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9275374e-96f5-4d57-beb2-3e247f4b1f11 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.202519 Jul 28 02:24:32.728121 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 414/819] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:32 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:33.538311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25202c7e-d9b8-40fc-aebb-7824293414e7 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52c88c10>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.586872 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-25202c7e-d9b8-40fc-aebb-7824293414e7 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 200 len: 354 microversion: 2.1 time: 0.052773 Jul 28 02:24:33.587442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 406/820] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:33 2022] GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:33.601556 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c85ddb9-34d0-4498-962f-d9655d036919 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52c9de50>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.651741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c85ddb9-34d0-4498-962f-d9655d036919 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 200 len: 354 microversion: 2.1 time: 0.054561 Jul 28 02:24:33.652618 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 415/821] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:33 2022] GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:33.665817 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8c0b860c-ba54-41f3-be29-874fe2fcda2d tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52c561f0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.727376 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.728408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:33.735240 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:33.736137 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:33.739043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8c0b860c-ba54-41f3-be29-874fe2fcda2d tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 202 len: 0 microversion: 2.1 time: 0.077047 Jul 28 02:24:33.739856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 407/822] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:24:33 2022] DELETE /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:24:33.747994 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7caa14fc-2207-4681-b88f-35391f7bd96e tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52c5c8b0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.753199 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:33.754041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:33.812352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7caa14fc-2207-4681-b88f-35391f7bd96e tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 200 len: 353 microversion: 2.1 time: 0.067565 Jul 28 02:24:33.812999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 408/823] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:33 2022] GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:33.817457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:33.818062 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:33.824342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:33.824814 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:33.828678 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:33.829157 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:33.994952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:34.005157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a4eef5b4-8ce1-47a0-9a39-4603a2f2cfc8 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.282020 Jul 28 02:24:34.005848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 416/824] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:33 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:34.023319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:34.031281 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e7358536-635d-40e0-83cf-5ee5e586f9bb tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1522 microversion: 2.1 time: 0.217130 Jul 28 02:24:34.031855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 409/825] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:33 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:34.197394 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e0397644-e980-4d90-a3d6-aa48597c96a3 req-a01178ea-3ab3-4fa9-b8ef-adf5be2d5663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fb7f5a-d860-4022-a284-a364155ba3ba", "name": "network-vif-deleted", "tag": "40d8500a-f1bf-4d76-ab1d-ab85d099d88f"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:34.207583 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e0397644-e980-4d90-a3d6-aa48597c96a3 req-a01178ea-3ab3-4fa9-b8ef-adf5be2d5663 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:34.208025 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e0397644-e980-4d90-a3d6-aa48597c96a3 req-a01178ea-3ab3-4fa9-b8ef-adf5be2d5663 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:34.219732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e0397644-e980-4d90-a3d6-aa48597c96a3 req-a01178ea-3ab3-4fa9-b8ef-adf5be2d5663 service nova] Creating event network-vif-deleted:40d8500a-f1bf-4d76-ab1d-ab85d099d88f for instance 57fb7f5a-d860-4022-a284-a364155ba3ba on hv-cinder-79987 Jul 28 02:24:34.224674 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e0397644-e980-4d90-a3d6-aa48597c96a3 req-a01178ea-3ab3-4fa9-b8ef-adf5be2d5663 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 Jul 28 02:24:34.225368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 417/826] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:34.826128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09d2e584-bb9e-4249-a0cf-1ea08950c904 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Calling method '.version_select at 0x7efc52eec310>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:34.855080 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-09d2e584-bb9e-4249-a0cf-1ea08950c904 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] HTTP exception thrown: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09d2e584-bb9e-4249-a0cf-1ea08950c904 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Request method failure captured: Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 HTTP/1.1 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fNfTuL7-e9n4sxf4TYlLKejqOi9XmmbOZoMuGBZwvs7wZ0RohnvRdh_rHdunXknApHJDGRNYTg7VHEoSe_Jle5lt9iB5GLUfOurCuQE2NZ4c9Jg3iYKzSKlQVbRMrUgEUKVPi7pgLmf0wliztqmndbQcKKoUipSNTkIopDyRmX3X84 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 6f7ba45d71244f8db991f45ead9d8684 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesGetTestJSON-1026228523 Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:34.866471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f7ba45d71244f8db991f45ead9d8684"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6f7ba45d71244f8db991f45ead9d8684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6f7ba45d71244f8db991f45ead9d8684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6f7ba45d71244f8db991f45ead9d8684"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesGetTestJSON-1026228523 Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 6f7ba45d71244f8db991f45ead9d8684 Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesGetTestJSON-1026228523 Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesGetTestJSON-1026228523-project Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 090698e59b0e4dc2baab5ba0f8a0a4e3 Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesGetTestJSON-1026228523-project Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '0e3a31f7-35aa-44ad-a187-e77d1158bcf5'} Jul 28 02:24:34.868128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. (HTTP 404) (Request-ID: req-7c2751ee-6db0-4ea2-ada7-62f131818c77) Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:34.869119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:24:34.870672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 02:24:34.872203 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09d2e584-bb9e-4249-a0cf-1ea08950c904 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] Returning 404 to user: Volume 0e3a31f7-35aa-44ad-a187-e77d1158bcf5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-09d2e584-bb9e-4249-a0cf-1ea08950c904 tempest-VolumesGetTestJSON-1026228523 tempest-VolumesGetTestJSON-1026228523-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5" status: 404 len: 109 microversion: 2.1 time: 0.045828 Jul 28 02:24:34.873773 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 410/827] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:34 2022] GET /compute/v2.1/os-volumes/0e3a31f7-35aa-44ad-a187-e77d1158bcf5 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:35.028714 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:35.029512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:35.038960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:35.038960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:35.038960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:35.038960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:35.054370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:35.055449 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:35.065671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:35.066790 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:35.068066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:35.068675 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:35.128801 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:35.129508 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:35.130267 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lazy-loading 'fault' on Instance uuid 57fb7f5a-d860-4022-a284-a364155ba3ba {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:24:35.199730 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a2f75083ec40f3a6254c25b57862ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5157a5b7f25482980f925175adf2090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:35.209298 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2ba3ed65-6af3-4e33-8044-4e7ab30ff5a3 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 200 len: 1312 microversion: 2.1 time: 0.160929 Jul 28 02:24:35.209979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 411/828] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:35 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:24:35.233482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:35.241451 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1b813e8d-90c5-4f19-92b3-0a01d925789e tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1574 microversion: 2.1 time: 0.217367 Jul 28 02:24:35.242055 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 418/829] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:35 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:36.232529 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:36.234058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] [instance: 57fb7f5a-d860-4022-a284-a364155ba3ba] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:36.239975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:36.240641 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:36.241425 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:36.241856 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:36.259217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] HTTP exception thrown: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Request method failure captured: Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba HTTP/1.1 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fI4YAiSBti0RGiamXJLr054Mccmo8rvde74uwjbQj0UtXB7BOuTcPsV4Bb9rWvj09egroTr6tu_RM6MWvtSlPWQP5ZtWXS8wTkrpo5ANOwpnyuyMXk7bGYvEqmPWkn6wCUkTS-5qVTh8T8iTjyMtRSbIVt0jdrHDfkdolNqTT8IX30 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:36.261311 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b5157a5b7f25482980f925175adf2090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b5157a5b7f25482980f925175adf2090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b5157a5b7f25482980f925175adf2090"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: b5157a5b7f25482980f925175adf2090 Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1799678427 Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 50a2f75083ec40f3a6254c25b57862ae Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1799678427-project Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. Jul 28 02:24:36.262694 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '57fb7f5a-d860-4022-a284-a364155ba3ba'} Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.264181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. Jul 28 02:24:36.266085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.267857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] Returning 404 to user: Instance 57fb7f5a-d860-4022-a284-a364155ba3ba could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.267857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-af6802fd-44f2-4569-876e-cd18f9e3cd46 tempest-ServerRescueNegativeTestJSON-1799678427 tempest-ServerRescueNegativeTestJSON-1799678427-project] 10.222.0.40 "GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba" status: 404 len: 111 microversion: 2.1 time: 0.034587 Jul 28 02:24:36.267857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 412/830] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:36 2022] GET /compute/v2.1/servers/57fb7f5a-d860-4022-a284-a364155ba3ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:36.268629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:36.268629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:36.272085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:36.272647 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:36.273573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:36.274587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:36.422193 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-24e1f076-36c3-46a6-9d02-292e9a1a20b1 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Action: 'create', calling method: .version_select at 0x7efc52c2f790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1480165031", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:36.432064 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:36.439898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a124d282-4f97-436e-98ea-60113180814f tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1561 microversion: 2.1 time: 0.180539 Jul 28 02:24:36.440568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 419/831] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:24:36 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-24e1f076-36c3-46a6-9d02-292e9a1a20b1 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 122 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:36.450473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1480165031", "metadata": {"Type": "work"}}} Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:24:36.452584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1480165031', 'metadata': {'Type': 'work'}}}} Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise error Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.453786 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 02:24:36.455483 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 02:24:36.457338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 02:24:36.457338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.457338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-24e1f076-36c3-46a6-9d02-292e9a1a20b1 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.457338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-24e1f076-36c3-46a6-9d02-292e9a1a20b1 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169580 Jul 28 02:24:36.460917 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 413/832] 10.222.0.40 () {60 vars in 1156 bytes} [Thu Jul 28 02:24:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:24:36.462566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-07981215-128a-48a8-9a3f-ef2015e269b8 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Action: 'create', calling method: .version_select at 0x7efc52c75430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1699852007", "metadata": {"Type": "work"}}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-07981215-128a-48a8-9a3f-ef2015e269b8 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 120 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:36.468004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1699852007", "metadata": {"Type": "work"}}} Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: Jul 28 02:24:36.470008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1699852007', 'metadata': {'Type': 'work'}}}} Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise error Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi '0' Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.471092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 02:24:36.472720 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 02:24:36.478031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 02:24:36.478031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.478031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-07981215-128a-48a8-9a3f-ef2015e269b8 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.478031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-07981215-128a-48a8-9a3f-ef2015e269b8 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012383 Jul 28 02:24:36.478031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 420/833] 10.222.0.40 () {60 vars in 1156 bytes} [Thu Jul 28 02:24:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:24:36.482095 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2cd6f8b9-ab4e-46cd-b034-8ae245736b53 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Action: 'create', calling method: .version_select at 0x7efc52c028b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1283499666", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2cd6f8b9-ab4e-46cd-b034-8ae245736b53 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 119 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:36.486519 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1283499666", "metadata": {"Type": "work"}}} Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:24:36.488305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1283499666', 'metadata': {'Type': 'work'}}}} Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise error Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi '' Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.492599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 02:24:36.494113 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 02:24:36.495347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 02:24:36.495347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.495347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2cd6f8b9-ab4e-46cd-b034-8ae245736b53 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.495347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2cd6f8b9-ab4e-46cd-b034-8ae245736b53 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009984 Jul 28 02:24:36.495347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 414/834] 10.222.0.40 () {60 vars in 1156 bytes} [Thu Jul 28 02:24:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:24:36.501092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-481c0ef4-3502-4e92-a9d0-fe538bcc2dd6 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Calling method '.version_select at 0x7efc52cdda60>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:36.533466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-481c0ef4-3502-4e92-a9d0-fe538bcc2dd6 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] HTTP exception thrown: Volume tempest-invalid-418011635 could not be found. Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-481c0ef4-3502-4e92-a9d0-fe538bcc2dd6 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-418011635 HTTP/1.1 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:36.536631 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Volume tempest-invalid-418011635 could not be found. Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'tempest-invalid-418011635'} Jul 28 02:24:36.538346 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-418011635 could not be found. (HTTP 404) (Request-ID: req-8c1a8247-af7b-46f1-93c6-b286b7beeae5) Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.539540 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:24:36.541177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-418011635 could not be found. Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:36.542716 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-418011635 could not be found. Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-418011635 could not be found. Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-481c0ef4-3502-4e92-a9d0-fe538bcc2dd6 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 404 to user: Volume tempest-invalid-418011635 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-481c0ef4-3502-4e92-a9d0-fe538bcc2dd6 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-418011635" status: 404 len: 98 microversion: 2.1 time: 0.041553 Jul 28 02:24:36.544766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 421/835] 10.222.0.40 () {58 vars in 1215 bytes} [Thu Jul 28 02:24:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-418011635 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 02:24:36.549642 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c43eb14-5f62-4775-95da-86e09a2a7a2a tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004835 Jul 28 02:24:36.550225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 415/836] 10.222.0.40 () {58 vars in 1140 bytes} [Thu Jul 28 02:24:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 02:24:36.559682 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-35374e02-a086-4c0d-a416-8329f0b33588 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003810 Jul 28 02:24:36.560179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 422/837] 10.222.0.40 () {58 vars in 1137 bytes} [Thu Jul 28 02:24:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 02:24:36.570336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-645dd976-b304-4692-8539-cebcdf3cc7d5 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Calling method '.version_select at 0x7efc52c2f0d0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:36.600217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-645dd976-b304-4692-8539-cebcdf3cc7d5 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] HTTP exception thrown: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-645dd976-b304-4692-8539-cebcdf3cc7d5 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/os-volumes/fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad HTTP/1.1 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:36.602227 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': 'fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad'} Jul 28 02:24:36.603849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. (HTTP 404) (Request-ID: req-9de9e7ff-114f-4309-afec-5985683d890a) Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.604667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:24:36.605869 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 02:24:36.606980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-645dd976-b304-4692-8539-cebcdf3cc7d5 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 404 to user: Volume fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-645dd976-b304-4692-8539-cebcdf3cc7d5 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad" status: 404 len: 109 microversion: 2.1 time: 0.037408 Jul 28 02:24:36.608117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 416/838] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:24:36 2022] DELETE /compute/v2.1/os-volumes/fcfd61f1-5e6e-4366-b3b2-4285fa7ac6ad => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:24:36.613890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b2c7c9-8621-45c6-b738-2ca3a6a9b275 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Calling method '.version_select at 0x7efc52ccc040>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:36.644558 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-66b2c7c9-8621-45c6-b738-2ca3a6a9b275 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] HTTP exception thrown: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b2c7c9-8621-45c6-b738-2ca3a6a9b275 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Request method failure captured: Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-volumes/ab230921-8c8d-4695-afba-2fb67bc2d8f4 HTTP/1.1 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fNktz9DZE6yn8_V2nJCmcFppTjGb7CM5QJp3pTVGTvWPM22TNiAoKVFio6qSY9fgAVX_KfrtI_SS87ceBImV76XA1alhSchY5g71J8-BcRvVDorF_EWoFOd3BCd64iFlFsNGIdzrwfLyqUOlhDmK1Z9pDnljyjPJ0wqpl3gJyKmrq8 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:36.646619 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_40bd0469b2cf40748e6ea9bde50bd658"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 40bd0469b2cf40748e6ea9bde50bd658 Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1218123966 Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 99bc9fc859e148d79578dabd27ee1746 Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1218123966-project Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'ab230921-8c8d-4695-afba-2fb67bc2d8f4'} Jul 28 02:24:36.648151 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. (HTTP 404) (Request-ID: req-2e81ac9e-af1b-4fad-b606-8d09ffe68efb) Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.649136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:24:36.650311 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 02:24:36.651551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b2c7c9-8621-45c6-b738-2ca3a6a9b275 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] Returning 404 to user: Volume ab230921-8c8d-4695-afba-2fb67bc2d8f4 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-66b2c7c9-8621-45c6-b738-2ca3a6a9b275 tempest-VolumesNegativeTest-1218123966 tempest-VolumesNegativeTest-1218123966-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/ab230921-8c8d-4695-afba-2fb67bc2d8f4" status: 404 len: 109 microversion: 2.1 time: 0.038020 Jul 28 02:24:36.652675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 423/839] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:24:36 2022] GET /compute/v2.1/os-volumes/ab230921-8c8d-4695-afba-2fb67bc2d8f4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:24:37.781014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-92c88a67-a533-4065-a54c-300f24373bae req-85fd9de3-d850-4a74-857c-ce3705e7e3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "name": "network-vif-plugged", "status": "completed", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:37.800767 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-92c88a67-a533-4065-a54c-300f24373bae req-85fd9de3-d850-4a74-857c-ce3705e7e3ec service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:37.801307 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-92c88a67-a533-4065-a54c-300f24373bae req-85fd9de3-d850-4a74-857c-ce3705e7e3ec service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:37.819312 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-92c88a67-a533-4065-a54c-300f24373bae req-85fd9de3-d850-4a74-857c-ce3705e7e3ec service nova] Creating event network-vif-plugged:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:24:37.829620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-92c88a67-a533-4065-a54c-300f24373bae req-85fd9de3-d850-4a74-857c-ce3705e7e3ec service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050602 Jul 28 02:24:37.830297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 417/840] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:24:52.461378 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.462138 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.467494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:52.470380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:52.479038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.479492 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.480263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.480700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.511152 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9d7bf889-78e0-4f09-ba67-00fdcf7996da tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051346 Jul 28 02:24:52.511700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 424/841] 10.222.0.40 () {60 vars in 1343 bytes} [Thu Jul 28 02:24:52 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:24:52.570347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.571090 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:24:52.575457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:52.576037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:52.584345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.584774 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.586260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.586260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.614631 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:24:52.704290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0b9e125d-c093-47e0-8650-2e58d85aa99f tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 204 len: 0 microversion: 2.20 time: 0.135225 Jul 28 02:24:52.705379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 418/842] 10.222.0.40 () {60 vars in 1280 bytes} [Thu Jul 28 02:24:52 2022] DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 02:24:52.714431 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:52.714893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:52.721755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.722391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.723545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:52.723993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:52.868429 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:52.877231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:52.878793 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:52.880140 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-148a8468-8c4e-47ac-914c-0f1aa2e70350 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.170626 Jul 28 02:24:52.880692 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 425/843] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:52 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:53.904056 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:53.906583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:53.913797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:53.914243 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:53.915470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:53.916188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:54.073276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:54.083586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:54.085409 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:54.086574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cd3f3733-5178-4c98-8b4f-cc4a4eb38d28 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1722 microversion: 2.20 time: 0.186934 Jul 28 02:24:54.087120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 419/844] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:53 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:55.112695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:55.114068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:55.132601 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-56e78a2f-bba3-4f51-bbb3-65f8c92446b7 req-487154c2-2a7b-419b-aafa-a21488d71a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b88dd0f-664f-42f1-b13f-ee78e8a3a00f", "name": "network-vif-deleted", "tag": "1715844b-9d8a-4da7-a69b-2981f259a665"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:24:55.138168 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:55.140967 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:55.141984 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:55.144572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:55.165091 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56e78a2f-bba3-4f51-bbb3-65f8c92446b7 req-487154c2-2a7b-419b-aafa-a21488d71a76 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:55.165642 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-56e78a2f-bba3-4f51-bbb3-65f8c92446b7 req-487154c2-2a7b-419b-aafa-a21488d71a76 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:55.198662 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-56e78a2f-bba3-4f51-bbb3-65f8c92446b7 req-487154c2-2a7b-419b-aafa-a21488d71a76 service nova] Creating event network-vif-deleted:1715844b-9d8a-4da7-a69b-2981f259a665 for instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f on hv-cinder-79987 Jul 28 02:24:55.218809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-56e78a2f-bba3-4f51-bbb3-65f8c92446b7 req-487154c2-2a7b-419b-aafa-a21488d71a76 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089084 Jul 28 02:24:55.220629 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 420/845] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:24:55.267520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:55.281717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:55.285880 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67ffe17468b04aa6ab148a976b5464b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed45da3e0024fa597d03299abae9859', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:24:55.289667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f63b58e-c8e5-4d16-873d-c5c4b56dea6d tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 200 len: 1655 microversion: 2.20 time: 0.181742 Jul 28 02:24:55.293178 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 426/846] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:55 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 1655 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 02:24:56.317340 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:56.318230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:56.325248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:56.325779 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:56.326720 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:56.327525 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:56.341264 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f HTTP/1.1 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:56.344011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:56.345510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '4b88dd0f-664f-42f1-b13f-ee78e8a3a00f'} Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:56.346403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:56.347939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:56.349268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:56.349664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8ad1090c-4186-4451-bdbc-4544b5eb0f10 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 404 len: 111 microversion: 2.20 time: 0.036244 Jul 28 02:24:56.360212 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 421/847] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:56 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:24:56.365912 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ee3c0c7-5bc0-4d58-ad4b-febaf5a47326 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '.version_select at 0x7efc52d25040>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:56.385606 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ee3c0c7-5bc0-4d58-ad4b-febaf5a47326 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083953056" status: 204 len: 0 microversion: 2.20 time: 0.023283 Jul 28 02:24:56.386196 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 427/848] 10.222.0.40 () {60 vars in 1262 bytes} [Thu Jul 28 02:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083953056 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 02:24:58.184800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:58.185328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:58.192035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:58.192488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:58.193305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:58.193744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:58.207516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f HTTP/1.1 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:24:58.209116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.210750 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '4b88dd0f-664f-42f1-b13f-ee78e8a3a00f'} Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:58.211545 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.212852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.214386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:58.214386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6392121b-ebeb-4f61-aea5-ec6b519bdc96 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 404 len: 111 microversion: 2.20 time: 0.029555 Jul 28 02:24:58.214386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 422/849] 10.222.0.40 () {60 vars in 1280 bytes} [Thu Jul 28 02:24:58 2022] DELETE /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:24:58.221819 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:24:58.222441 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:24:58.229330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:58.229789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:58.230566 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:24:58.231004 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:24:58.244564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f HTTP/1.1 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:24:58.246190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.247813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '4b88dd0f-664f-42f1-b13f-ee78e8a3a00f'} Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:24:58.248791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. Jul 28 02:24:58.250053 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:24:58.251164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 4b88dd0f-664f-42f1-b13f-ee78e8a3a00f could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:24:58.251164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d25be0cf-5ea1-479c-b0cc-311a00775097 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f" status: 404 len: 111 microversion: 2.20 time: 0.032396 Jul 28 02:24:58.251164 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 428/850] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:24:58 2022] GET /compute/v2.1/servers/4b88dd0f-664f-42f1-b13f-ee78e8a3a00f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 02:25:01.493175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:01.493672 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:01.501506 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:01.501977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:01.503092 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:01.503533 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:01.519490 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 HTTP/1.1 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:25:01.521078 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.522812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '37f3fd25-2f4e-4cbc-8c43-158fc08ece33'} Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:25:01.523719 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.525194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.526661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:25:01.526661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c74f5f6b-09fc-4a37-bf91-858be2fd3f6e tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 404 len: 111 microversion: 2.20 time: 0.033197 Jul 28 02:25:01.526661 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 423/851] 10.222.0.40 () {60 vars in 1280 bytes} [Thu Jul 28 02:25:01 2022] DELETE /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:25:01.531259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:01.532330 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] [instance: 37f3fd25-2f4e-4cbc-8c43-158fc08ece33] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:01.538333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:01.538783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:01.539545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:01.539978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:01.554083 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] HTTP exception thrown: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Request method failure captured: Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 HTTP/1.1 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fHfRw7Xyu7r17ccJIRo2BZy9G32YZKqp6cWyZ2_zOa2a2RsOf_wfBMNu_5eZiyp0J73Y-Zwck-NTkKvhJNpvwurt0afRCongaMjac39sYe3ME1kKj5OvVhy2jv96qIVDmmHZ0OF7jyv_Dn5PObSgzOPMy6_RbBifp77shJP6BgT3Ac Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:25:01.555907 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1ed45da3e0024fa597d03299abae9859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1ed45da3e0024fa597d03299abae9859"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 1ed45da3e0024fa597d03299abae9859 Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674315472 Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 67ffe17468b04aa6ab148a976b5464b4 Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674315472-project Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.558048 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '37f3fd25-2f4e-4cbc-8c43-158fc08ece33'} Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:25:01.559402 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. Jul 28 02:25:01.561607 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:25:01.563844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] Returning 404 to user: Instance 37f3fd25-2f4e-4cbc-8c43-158fc08ece33 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:25:01.563844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02ecab8b-c27b-43c9-b34d-1bf24a8e5e66 tempest-AttachVolumeShelveTestJSON-1674315472 tempest-AttachVolumeShelveTestJSON-1674315472-project] 10.222.0.40 "GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33" status: 404 len: 111 microversion: 2.20 time: 0.030234 Jul 28 02:25:01.563844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 429/852] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 28 02:25:01 2022] GET /compute/v2.1/servers/37f3fd25-2f4e-4cbc-8c43-158fc08ece33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 02:25:11.498909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:11.509297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:11.585915 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-923f8816-23ba-4fd8-bb98-11bfdcf545e0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: .version_select at 0x7efc52c2fc10>, body: {"keypair": {"name": "tempest-keypair-1124537563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeCkuQtg+W2OXJu0p+FpMlBR340P0BZ+A4T65tdS6KKS6BtTRjRpBcz2d1i7kGifsVZyoIcDbobXhuUmppUjnJRpQYLAXmEM35bb4aI8VJ9oHomD5/9YT2NVafn2q2HgQ=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:11.602229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-923f8816-23ba-4fd8-bb98-11bfdcf545e0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:25:11.606111 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-923f8816-23ba-4fd8-bb98-11bfdcf545e0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for user 8cec16b821114fc0aa47e8549cacd7d0 and project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:25:11.631100 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-923f8816-23ba-4fd8-bb98-11bfdcf545e0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206078 Jul 28 02:25:11.631756 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 424/853] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:25:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:13.096609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1378490194", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2acebb6b-631e-460d-a599-e4c28fc62f29"}], "security_groups": [{"name": "tempest-securitygroup--327624713"}], "key_name": "tempest-keypair-1124537563", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:13.105255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:13.105896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=22 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:13.223935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] validate_networks() for [('2acebb6b-631e-460d-a599-e4c28fc62f29', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:25:13.664475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:25:13.664930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:25:13.665411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:25:13.665820 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:25:13.666235 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:25:13.675343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:13.675788 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:13.676701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:13.677166 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:13.699633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:25:13.704169 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for user 8cec16b821114fc0aa47e8549cacd7d0 and project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:25:13.715206 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:25:13.717757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:25:13.768069 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c72a1d96-32e2-43ad-a27c-1bb84e0692c9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677054 Jul 28 02:25:13.768901 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 430/854] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:25:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:25:13.779904 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dce0e8b3-94ef-4357-9725-f9c35aa42fae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:13.780564 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dce0e8b3-94ef-4357-9725-f9c35aa42fae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:13.844058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dce0e8b3-94ef-4357-9725-f9c35aa42fae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:13.851748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dce0e8b3-94ef-4357-9725-f9c35aa42fae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1238 microversion: 2.1 time: 0.076075 Jul 28 02:25:13.852338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 425/855] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:13 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:14.879195 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:14.879823 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:14.896494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:14.898210 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:14.899480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:14.900319 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:15.019237 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:15.037189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ffe98945-395c-4ec9-b372-718ad318428b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1298 microversion: 2.1 time: 0.168634 Jul 28 02:25:15.038500 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 431/856] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:14 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:16.059919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:16.061010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:16.067652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:16.068111 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:16.068903 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:16.069343 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:16.226704 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:16.235210 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-52b21bba-072b-4d3c-86da-f63145fb88c6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.180027 Jul 28 02:25:16.235795 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 426/857] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:16 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:25:16.612777 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b11d9c21-2f39-461f-b429-e06ecf87af02 req-b32f1d97-f126-4df3-8ea0-79a90f763b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7852b5-c448-4c73-8090-8c75c15d6900", "tag": "5535562d-0c12-47d5-b1c1-dbf26caaa058"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:16.626264 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b11d9c21-2f39-461f-b429-e06ecf87af02 req-b32f1d97-f126-4df3-8ea0-79a90f763b7a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:16.626940 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b11d9c21-2f39-461f-b429-e06ecf87af02 req-b32f1d97-f126-4df3-8ea0-79a90f763b7a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:16.641009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b11d9c21-2f39-461f-b429-e06ecf87af02 req-b32f1d97-f126-4df3-8ea0-79a90f763b7a service nova] Creating event network-changed:5535562d-0c12-47d5-b1c1-dbf26caaa058 for instance bb7852b5-c448-4c73-8090-8c75c15d6900 on hv-cinder-79987 Jul 28 02:25:16.646561 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-b11d9c21-2f39-461f-b429-e06ecf87af02 req-b32f1d97-f126-4df3-8ea0-79a90f763b7a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043975 Jul 28 02:25:16.647372 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 432/858] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:25:17.256577 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:17.257224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:17.263736 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:17.264185 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:17.264999 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:17.265443 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:17.397039 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:17.404820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7bdc32fb-c13b-4a05-9917-a06be1b2ea63 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.152003 Jul 28 02:25:17.406045 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 427/859] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:17 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:18.427322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:18.428014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:18.434743 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:18.435192 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:18.435986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:18.436415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:18.571801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:18.579853 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e4e7ef3d-83d7-4d1d-806e-f1c0c9768869 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.156755 Jul 28 02:25:18.580408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 433/860] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:18 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:19.600650 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:19.601284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:19.607664 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:19.608102 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:19.608850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:19.609353 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:19.741624 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:19.749516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-16b7cb75-455a-4e35-839a-9295f92c9821 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.152707 Jul 28 02:25:19.750135 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 428/861] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:19 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:20.770154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:20.770770 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:20.777317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:20.777771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:20.778536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:20.778975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:20.907606 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:20.914968 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05b08e72-d8e3-4405-8f88-27e48e1d6b21 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.148681 Jul 28 02:25:20.915523 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 434/862] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:20 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:21.935571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:21.936116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:21.943229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:21.943674 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:21.944423 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:21.944852 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:22.077302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:22.084681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f3b4db3c-157b-4fe4-b302-505070bbcd8c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.153045 Jul 28 02:25:22.085292 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 429/863] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:21 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:22.427512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-467f6d81-4e32-4353-a6f3-c3da1de0c9fe req-2b2788e7-f7ae-4e49-a221-2544d456ed5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7852b5-c448-4c73-8090-8c75c15d6900", "name": "network-vif-plugged", "status": "completed", "tag": "5535562d-0c12-47d5-b1c1-dbf26caaa058"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:22.438918 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-467f6d81-4e32-4353-a6f3-c3da1de0c9fe req-2b2788e7-f7ae-4e49-a221-2544d456ed5b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:22.439442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-467f6d81-4e32-4353-a6f3-c3da1de0c9fe req-2b2788e7-f7ae-4e49-a221-2544d456ed5b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:22.451904 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-467f6d81-4e32-4353-a6f3-c3da1de0c9fe req-2b2788e7-f7ae-4e49-a221-2544d456ed5b service nova] Creating event network-vif-plugged:5535562d-0c12-47d5-b1c1-dbf26caaa058 for instance bb7852b5-c448-4c73-8090-8c75c15d6900 on hv-cinder-79987 Jul 28 02:25:22.457248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-467f6d81-4e32-4353-a6f3-c3da1de0c9fe req-2b2788e7-f7ae-4e49-a221-2544d456ed5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Jul 28 02:25:22.458077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 435/864] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:23.105424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:23.106052 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:23.112770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:23.113242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:23.114006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:23.114443 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:23.246175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:23.254107 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-793fec46-287a-4d3e-9426-912dcecf43f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.152548 Jul 28 02:25:23.254659 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 430/865] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:23 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:24.272748 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:24.273526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:24.277572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:24.278269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:24.286033 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:24.286482 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:24.287254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:24.287684 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:24.434487 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:24.442711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc0457a9-aec1-4d40-9850-1368ded86dd0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1363 microversion: 2.1 time: 0.171284 Jul 28 02:25:24.443289 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 436/866] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:24 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:25.463522 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:25.464169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:25.466116 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:25.472600 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:25.473098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:25.473868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:25.474308 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:25.600975 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:25.608327 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e64df555-18ef-490b-8afa-c242ce276ab3 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1550 microversion: 2.1 time: 0.148674 Jul 28 02:25:25.608960 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 431/867] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:25 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1550 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:25.629555 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:25.630033 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:25.636521 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:25.637013 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:25.637784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:25.638368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:25.716267 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf47d6eb-c1bc-4ad3-9a6d-3e1f1c0f5d46 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090505 Jul 28 02:25:25.717153 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 437/868] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:25:25 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:26.915058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-96752982-708e-42f8-8510-f3f3b26cb564 req-219eb224-dd0f-42d3-91ab-400a3d2741f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7852b5-c448-4c73-8090-8c75c15d6900", "tag": "5535562d-0c12-47d5-b1c1-dbf26caaa058"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:26.926299 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-96752982-708e-42f8-8510-f3f3b26cb564 req-219eb224-dd0f-42d3-91ab-400a3d2741f5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:26.927007 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-96752982-708e-42f8-8510-f3f3b26cb564 req-219eb224-dd0f-42d3-91ab-400a3d2741f5 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:26.939123 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-96752982-708e-42f8-8510-f3f3b26cb564 req-219eb224-dd0f-42d3-91ab-400a3d2741f5 service nova] Creating event network-changed:5535562d-0c12-47d5-b1c1-dbf26caaa058 for instance bb7852b5-c448-4c73-8090-8c75c15d6900 on hv-cinder-79987 Jul 28 02:25:26.944639 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-96752982-708e-42f8-8510-f3f3b26cb564 req-219eb224-dd0f-42d3-91ab-400a3d2741f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Jul 28 02:25:26.945312 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 432/869] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:30.443528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-952620266", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:30.496564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] validate_networks() for None {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:25:30.772438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:25:30.772856 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:25:30.773345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:25:30.773749 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:25:30.774154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:25:30.783226 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:30.783667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:30.784456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:30.784979 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:30.802608 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Getting quotas for project 07e26e0d100743839e276fb6db269958. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:25:30.806637 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Getting quotas for user 5d18ce7f418a4a7b8bb300b618ed21f6 and project 07e26e0d100743839e276fb6db269958. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:25:30.818501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:25:30.820737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:25:30.865176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5e5a25a4-de6d-4029-b50f-763c1d03312c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425915 Jul 28 02:25:30.865874 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 438/870] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:25:30.879847 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a46cc7ff-6c24-4df6-992c-74e7f7fd31be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:30.882618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a46cc7ff-6c24-4df6-992c-74e7f7fd31be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:30.939188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a46cc7ff-6c24-4df6-992c-74e7f7fd31be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:30.945979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a46cc7ff-6c24-4df6-992c-74e7f7fd31be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1214 microversion: 2.1 time: 0.070861 Jul 28 02:25:30.946558 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 433/871] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:30 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:31.970594 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:31.971827 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:31.983762 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:31.984382 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:31.985575 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:31.986089 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:32.318896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:32.326568 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-862538d2-d119-4b2c-ba56-cde4b69a41d6 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1272 microversion: 2.1 time: 0.362604 Jul 28 02:25:32.327246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 439/872] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:31 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1272 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:33.350350 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:33.351647 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:33.366289 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:33.367024 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:33.369478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:33.369931 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:33.443163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e34e4cc8-5ccc-4c35-9586-e0efd5e7e5db req-cddc386c-2118-498c-a4d2-1f082a95282d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24ae8d32-009b-493e-a7e8-3af888dd2ee3", "tag": "f6022a36-d845-4630-bb0c-fc1e3bbff131"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:33.476247 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e34e4cc8-5ccc-4c35-9586-e0efd5e7e5db req-cddc386c-2118-498c-a4d2-1f082a95282d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:33.477007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e34e4cc8-5ccc-4c35-9586-e0efd5e7e5db req-cddc386c-2118-498c-a4d2-1f082a95282d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:33.490797 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e34e4cc8-5ccc-4c35-9586-e0efd5e7e5db req-cddc386c-2118-498c-a4d2-1f082a95282d service nova] Creating event network-changed:f6022a36-d845-4630-bb0c-fc1e3bbff131 for instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 on hv-cinder-79987 Jul 28 02:25:33.496450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e34e4cc8-5ccc-4c35-9586-e0efd5e7e5db req-cddc386c-2118-498c-a4d2-1f082a95282d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057724 Jul 28 02:25:33.497718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 440/873] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:25:33.550212 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:33.559657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-411047c2-55d8-4e06-b41d-8f0a7843e406 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.213178 Jul 28 02:25:33.560244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 434/874] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:33 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:25:34.583190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:34.583886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:34.590119 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:34.590570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:34.591587 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:34.592112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:34.725054 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:34.732649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09ab78e3-d347-403e-a601-31b1a019d47e tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.154288 Jul 28 02:25:34.733490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 441/875] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:34 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:35.754339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:35.754943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:35.769983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:35.770442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:35.771232 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:35.771671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:35.900205 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:35.908053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4fc4116-b4cb-4c12-98e9-c31f83441c3a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.157602 Jul 28 02:25:35.908623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 435/876] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:35 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:36.929567 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:36.930147 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:36.936670 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:36.937889 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:36.938661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:36.939136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:37.081494 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:37.089683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0fc1d29e-194c-4f77-9258-bd04700153c1 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.164062 Jul 28 02:25:37.090251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 442/877] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:36 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:38.112384 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:38.113169 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:38.119560 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:38.119998 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:38.120745 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:38.121290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:38.252787 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:38.260147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a35fd40-d427-4c81-ab19-1dcc290bb2f5 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.151797 Jul 28 02:25:38.260735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 436/878] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:38 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:39.281731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:39.282295 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:39.288760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:39.289229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:39.289986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:39.290412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:39.433358 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:39.441805 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26427f01-0cf3-4826-b361-ac5afe1148d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.164648 Jul 28 02:25:39.442395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 443/879] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:39 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:40.464691 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:40.465595 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:40.474565 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:40.474777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:40.475609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:40.476087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:40.633337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:40.641967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-137c5a89-9008-4933-8118-335f8d583c41 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.181260 Jul 28 02:25:40.642557 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 437/880] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:40 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:41.664339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:41.664906 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:41.667265 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:41.667930 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:41.675285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:41.675739 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:41.676509 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:41.676977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:41.803047 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:41.810324 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9a53d34e-31cd-4718-9e0a-9b797abd528a tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.149949 Jul 28 02:25:41.810885 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 444/881] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:41 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:42.568454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2360986e-cf6f-42e4-8554-ee9f1658f31f req-338fae1e-c55d-45fd-ba6f-31caf734346a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ae8d32-009b-493e-a7e8-3af888dd2ee3", "name": "network-vif-plugged", "status": "completed", "tag": "f6022a36-d845-4630-bb0c-fc1e3bbff131"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:42.573547 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:42.574681 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:42.584319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2360986e-cf6f-42e4-8554-ee9f1658f31f req-338fae1e-c55d-45fd-ba6f-31caf734346a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:42.585133 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2360986e-cf6f-42e4-8554-ee9f1658f31f req-338fae1e-c55d-45fd-ba6f-31caf734346a service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:42.589961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=63 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:42.602728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2360986e-cf6f-42e4-8554-ee9f1658f31f req-338fae1e-c55d-45fd-ba6f-31caf734346a service nova] Creating event network-vif-plugged:f6022a36-d845-4630-bb0c-fc1e3bbff131 for instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 on hv-cinder-79987 Jul 28 02:25:42.608803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2360986e-cf6f-42e4-8554-ee9f1658f31f req-338fae1e-c55d-45fd-ba6f-31caf734346a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044472 Jul 28 02:25:42.611613 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 438/882] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:42.830659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:42.831355 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:42.837895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:42.838417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:42.839248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:42.839683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:42.982667 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:42.990991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-75ca4e9a-86ee-40e9-a86f-553cea24ec8c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.164342 Jul 28 02:25:42.991563 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 445/883] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:42 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:44.014106 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:44.014803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:44.021572 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:44.022019 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:44.022778 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:44.023213 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:44.164564 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:44.172603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-20f62110-94b0-46ef-9f4c-9610112a67d7 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1314 microversion: 2.1 time: 0.163172 Jul 28 02:25:44.173215 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 439/884] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:44 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:45.194676 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:45.195283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:45.197569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:45.203415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.203859 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.204659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.205100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.209075 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=75 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:25:45.339332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:45.347897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1334713d-0947-42e9-ba62-d75eb5df2d61 tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1463 microversion: 2.1 time: 0.157172 Jul 28 02:25:45.348467 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 446/885] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:45 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:45.393721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:45.394830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:45.401599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.402405 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.403701 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.404335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.430813 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:25:45.511788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0298cbf7-8bb6-4eba-9dab-f74574a8f5be tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "DELETE /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 204 len: 0 microversion: 2.1 time: 0.121528 Jul 28 02:25:45.512399 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 440/886] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:25:45 2022] DELETE /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:25:45.520659 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:45.521370 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:45.527545 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.528087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.529008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:45.529390 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:45.662668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:45.670177 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f67d98a5-114d-43f4-8247-407dd27ad92c tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1469 microversion: 2.1 time: 0.153351 Jul 28 02:25:45.670739 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 447/887] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:45 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:25:46.694111 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:46.694873 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:46.701322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:46.701767 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:46.703233 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:46.703670 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:46.835457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d18ce7f418a4a7b8bb300b618ed21f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e26e0d100743839e276fb6db269958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:46.843369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-df588595-1327-4733-8c8a-af481df19a0d tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 200 len: 1469 microversion: 2.1 time: 0.154510 Jul 28 02:25:46.843932 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 441/888] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:46 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:47.378935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-3ee4cbf1-5acc-4c69-beab-0696e01be46e req-ad7fcd87-d163-4e7c-91ea-9cd199ce716f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24ae8d32-009b-493e-a7e8-3af888dd2ee3", "name": "network-vif-deleted", "tag": "f6022a36-d845-4630-bb0c-fc1e3bbff131"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:47.390288 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3ee4cbf1-5acc-4c69-beab-0696e01be46e req-ad7fcd87-d163-4e7c-91ea-9cd199ce716f service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:47.391059 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3ee4cbf1-5acc-4c69-beab-0696e01be46e req-ad7fcd87-d163-4e7c-91ea-9cd199ce716f service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:47.404038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-3ee4cbf1-5acc-4c69-beab-0696e01be46e req-ad7fcd87-d163-4e7c-91ea-9cd199ce716f service nova] Creating event network-vif-deleted:f6022a36-d845-4630-bb0c-fc1e3bbff131 for instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 on hv-cinder-79987 Jul 28 02:25:47.410333 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-3ee4cbf1-5acc-4c69-beab-0696e01be46e req-ad7fcd87-d163-4e7c-91ea-9cd199ce716f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Jul 28 02:25:47.411375 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 448/889] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:25:47.867016 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:47.867799 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] [instance: 24ae8d32-009b-493e-a7e8-3af888dd2ee3] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:47.877339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:47.877781 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:47.878543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:47.878972 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:47.894246 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] HTTP exception thrown: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Request method failure captured: Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 HTTP/1.1 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fOYpuWDrFZ0W2hPPwx_EyROoEQ0GVgG5kFBdyQiVnkzauSLD2AKEZnbcJnYyiicrqcXDApQ9suFNT7yrWQlFHoGYEA1W_MNLcBFX6Hj-ZuOX7_QkxrE94SjtR0hyPxe3wloGkAMHh149dq5Ni6Vg9PrUHsP8DXXHvnPsK515oohqvU Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 07e26e0d100743839e276fb6db269958 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1846870928 Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:25:47.896322 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07e26e0d100743839e276fb6db269958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07e26e0d100743839e276fb6db269958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07e26e0d100743839e276fb6db269958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07e26e0d100743839e276fb6db269958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1846870928 Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 07e26e0d100743839e276fb6db269958 Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1846870928 Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1846870928-project Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 5d18ce7f418a4a7b8bb300b618ed21f6 Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1846870928-project Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. Jul 28 02:25:47.898125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '24ae8d32-009b-493e-a7e8-3af888dd2ee3'} Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:25:47.899329 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. Jul 28 02:25:47.900733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:25:47.902171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] Returning 404 to user: Instance 24ae8d32-009b-493e-a7e8-3af888dd2ee3 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:25:47.902171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6a1ba914-00cd-4fe0-8271-1c6e96637efd tempest-VolumesNegativeTest-1846870928 tempest-VolumesNegativeTest-1846870928-project] 10.222.0.40 "GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3" status: 404 len: 111 microversion: 2.1 time: 0.035227 Jul 28 02:25:47.902171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 442/890] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:47 2022] GET /compute/v2.1/servers/24ae8d32-009b-493e-a7e8-3af888dd2ee3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:25:55.122314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2064456548", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "networks": [{"uuid": "3916ebe1-b0fe-4005-b8f0-849d68eba863"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:55.184376 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] validate_networks() for [('3916ebe1-b0fe-4005-b8f0-849d68eba863', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:25:55.552118 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:25:55.552543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:25:55.553091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:25:55.553505 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:25:55.553916 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:25:55.563077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:55.563520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:55.564357 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:55.564791 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:55.582977 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Getting quotas for project a0cbe4e537bf4a3295d73105f90ec4b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:25:55.586992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Getting quotas for user c83fc2f15859437faff8616fb7de3117 and project a0cbe4e537bf4a3295d73105f90ec4b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:25:55.598543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:25:55.600850 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:25:55.644174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a939c5ff-b59b-463f-996c-69ba684d0ec5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526616 Jul 28 02:25:55.644809 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 449/891] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:25:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:25:55.656943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bbd53027-2c99-44ce-9d61-969d448e7cbe tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:55.657600 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bbd53027-2c99-44ce-9d61-969d448e7cbe tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:55.711821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bbd53027-2c99-44ce-9d61-969d448e7cbe tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:55.720534 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bbd53027-2c99-44ce-9d61-969d448e7cbe tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1219 microversion: 2.1 time: 0.068616 Jul 28 02:25:55.721216 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 443/892] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:55 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:56.742919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:56.743620 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:56.751218 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:56.751755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:56.752628 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:56.753170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:56.815802 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:56.823495 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f33e299-192a-462d-80c8-72b5d7071478 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1277 microversion: 2.1 time: 0.085288 Jul 28 02:25:56.824269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 450/893] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:56 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:57.846709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:57.847778 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:57.857420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:57.857863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:57.858625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:57.859054 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:57.890208 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-eb6f85c0-6a9c-4ebd-9421-690b76dc734e req-3713bb29-d9ad-4f42-b41d-bf682422b557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74947e5c-adef-420f-996c-1cc87cda6bb9", "tag": "7aef719b-6297-463f-b7ff-bdd0663809fd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:25:57.905093 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-eb6f85c0-6a9c-4ebd-9421-690b76dc734e req-3713bb29-d9ad-4f42-b41d-bf682422b557 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:57.905835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-eb6f85c0-6a9c-4ebd-9421-690b76dc734e req-3713bb29-d9ad-4f42-b41d-bf682422b557 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:57.920846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-eb6f85c0-6a9c-4ebd-9421-690b76dc734e req-3713bb29-d9ad-4f42-b41d-bf682422b557 service nova] Creating event network-changed:7aef719b-6297-463f-b7ff-bdd0663809fd for instance 74947e5c-adef-420f-996c-1cc87cda6bb9 on hv-cinder-79987 Jul 28 02:25:57.926384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-eb6f85c0-6a9c-4ebd-9421-690b76dc734e req-3713bb29-d9ad-4f42-b41d-bf682422b557 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040689 Jul 28 02:25:57.927303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 451/894] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:25:58.006103 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:58.013657 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a9e631d1-bb6d-4cca-8339-617d232a53b5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.171496 Jul 28 02:25:58.014226 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 444/895] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:57 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:25:59.036395 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:25:59.038037 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:25:59.045799 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:59.046247 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:59.047275 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:25:59.048367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:25:59.206789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:25:59.214625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e7f922d2-62d9-4529-bd65-d847067ae3a1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.182401 Jul 28 02:25:59.215440 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 452/896] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:25:59 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:00.235828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:00.236558 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:00.243302 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:00.243755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:00.244574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:00.245057 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:00.379516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:00.387316 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c1d0007f-f104-438f-bd3e-da893ea76cb9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.155505 Jul 28 02:26:00.387878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 445/897] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:00 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:01.409842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:01.410565 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:01.417180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:01.417623 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:01.418412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:01.418842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:01.557633 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:01.565833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0e4738dc-c510-4f15-9e96-9ed3e671d3cc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.160293 Jul 28 02:26:01.566401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 453/898] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:01 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:02.587446 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:02.588099 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:02.597191 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:02.597645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:02.598418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:02.598863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:02.736635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:02.747554 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8861bf58-c406-4187-a185-4dcce0bc9112 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.163951 Jul 28 02:26:02.748480 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 446/899] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:02 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:02.869015 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:02.869798 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:02.876437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:02.876895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:02.877695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:02.878129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:02.902455 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9abab8b2-ac8b-42a4-8cf2-9b7a3288a44c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/ips" status: 200 len: 147 microversion: 2.1 time: 0.040382 Jul 28 02:26:02.903042 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 454/900] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:26:02 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:03.769275 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:03.770120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:03.777777 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:03.778225 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:03.779010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:03.779446 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:03.925596 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:03.934304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-722ea5ea-e8c8-4bb1-b151-94246e71009f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.168987 Jul 28 02:26:03.934879 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 447/901] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:03 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:04.607479 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-45967900-f91b-44b0-bc92-f860bc5e06a6 req-03456256-5226-4287-a05d-6a067e4a62ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74947e5c-adef-420f-996c-1cc87cda6bb9", "name": "network-vif-plugged", "status": "completed", "tag": "7aef719b-6297-463f-b7ff-bdd0663809fd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:04.619349 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-45967900-f91b-44b0-bc92-f860bc5e06a6 req-03456256-5226-4287-a05d-6a067e4a62ca service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:04.619771 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-45967900-f91b-44b0-bc92-f860bc5e06a6 req-03456256-5226-4287-a05d-6a067e4a62ca service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:04.631891 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-45967900-f91b-44b0-bc92-f860bc5e06a6 req-03456256-5226-4287-a05d-6a067e4a62ca service nova] Creating event network-vif-plugged:7aef719b-6297-463f-b7ff-bdd0663809fd for instance 74947e5c-adef-420f-996c-1cc87cda6bb9 on hv-cinder-79987 Jul 28 02:26:04.636688 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-45967900-f91b-44b0-bc92-f860bc5e06a6 req-03456256-5226-4287-a05d-6a067e4a62ca service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Jul 28 02:26:04.637350 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 455/902] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:04.956266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:04.956900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:04.963266 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:04.963708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:04.964456 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:04.964900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:05.100458 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:05.107762 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2225c853-853d-4814-acec-3710c72f7ab7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.155727 Jul 28 02:26:05.108319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 448/903] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:04 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:06.126258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:06.127866 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:06.132982 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:06.133703 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:06.141221 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:06.141675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:06.142721 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:06.143009 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:06.293535 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:06.301846 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-592f72d4-1ff9-4693-8244-0db05aa980c8 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1319 microversion: 2.1 time: 0.176607 Jul 28 02:26:06.302412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 456/904] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:06 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:07.325172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:07.325884 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:07.327897 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:07.334708 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:07.335171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:07.335916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:07.336352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:07.478845 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:07.487610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb92a8e8-cb04-4a72-a520-5d0426945d6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1507 microversion: 2.1 time: 0.166471 Jul 28 02:26:07.488392 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 449/905] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:07 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:07.826650 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8f6d70e-de62-4b77-a6b1-9c9234ee8eb9"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:07.829305 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:07.836678 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:07.837154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:07.838111 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:07.838570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:08.109614 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8d920cbb-3c7e-4147-b9a5-9a9603fdc993 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286736 Jul 28 02:26:08.115701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 457/906] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:26:07 2022] POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:11.430470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63874d8c-fe17-4e94-93e8-5e27d832d8be tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:11.437064 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63874d8c-fe17-4e94-93e8-5e27d832d8be tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.437582 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63874d8c-fe17-4e94-93e8-5e27d832d8be tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.500803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63874d8c-fe17-4e94-93e8-5e27d832d8be tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Going to try to stop instance {{(pid=117788) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 02:26:11.546356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63874d8c-fe17-4e94-93e8-5e27d832d8be tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action" status: 202 len: 0 microversion: 2.1 time: 0.119251 Jul 28 02:26:11.546800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 450/907] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:26:11 2022] POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:26:11.558079 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:11.558843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:11.568058 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.568579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.569031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:11.569512 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.569706 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:11.569968 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.576419 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.576860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.578252 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.578690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.606625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:26:11.708830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f57c141-05e1-4606-9ee7-26d78dec3ed7 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "DELETE /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 204 len: 0 microversion: 2.1 time: 0.144081 Jul 28 02:26:11.713703 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 451/908] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:26:11 2022] DELETE /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:26:11.720454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-4cfe9885-8b01-4756-889d-e9007d633ad5 req-89e1c0a3-363a-4ce4-ac6c-6f9c7454d56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:11.734955 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4cfe9885-8b01-4756-889d-e9007d633ad5 req-89e1c0a3-363a-4ce4-ac6c-6f9c7454d56d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.736060 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4cfe9885-8b01-4756-889d-e9007d633ad5 req-89e1c0a3-363a-4ce4-ac6c-6f9c7454d56d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.750697 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-4cfe9885-8b01-4756-889d-e9007d633ad5 req-89e1c0a3-363a-4ce4-ac6c-6f9c7454d56d service nova] Creating event network-changed:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:26:11.755149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:11.762646 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-4cfe9885-8b01-4756-889d-e9007d633ad5 req-89e1c0a3-363a-4ce4-ac6c-6f9c7454d56d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046932 Jul 28 02:26:11.763260 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 452/909] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:11.781246 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2fcae5a5-e267-4721-be9f-81b092fe0726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.214091 Jul 28 02:26:11.782467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:11.783186 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:11.784110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 458/910] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:11 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:11.792272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.793424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.794473 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:11.795121 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:11.817460 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:11.961578 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:11.969587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c41daa9-758b-4b85-b6e6-391e5f71038a tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.198195 Jul 28 02:26:11.970153 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 453/911] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:11 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:12.809893 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:12.810365 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:12.817124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:12.817588 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:12.818345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:12.818774 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:12.951972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:12.960468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-96994360-8168-4445-a4fe-d12ffa9741a1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.155034 Jul 28 02:26:12.961079 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 459/912] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:12 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:26:12.991507 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:12.992167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:12.994514 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:13.000752 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:13.001220 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:13.001977 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:13.002403 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:13.139316 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:13.148104 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f00e6736-e717-42d6-95b5-41ece3da148b tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1567 microversion: 2.1 time: 0.160990 Jul 28 02:26:13.148680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 454/913] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:12 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:13.983236 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:13.983850 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:13.991652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:13.993954 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:13.994943 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:13.996721 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:14.131515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a680e102-cb9e-486c-a9ac-2cfe5e604e3a req-9de99379-b5fa-4716-ace0-d20397075e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734a7df7-1d42-44b2-a43e-f71f1811a773", "name": "network-vif-deleted", "tag": "4361cfbc-bcbf-486b-ad6a-719f5fc09a5d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:14.159115 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a680e102-cb9e-486c-a9ac-2cfe5e604e3a req-9de99379-b5fa-4716-ace0-d20397075e73 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:14.160740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a680e102-cb9e-486c-a9ac-2cfe5e604e3a req-9de99379-b5fa-4716-ace0-d20397075e73 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:14.177633 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a680e102-cb9e-486c-a9ac-2cfe5e604e3a req-9de99379-b5fa-4716-ace0-d20397075e73 service nova] Creating event network-vif-deleted:4361cfbc-bcbf-486b-ad6a-719f5fc09a5d for instance 734a7df7-1d42-44b2-a43e-f71f1811a773 on hv-cinder-79987 Jul 28 02:26:14.185085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a680e102-cb9e-486c-a9ac-2cfe5e604e3a req-9de99379-b5fa-4716-ace0-d20397075e73 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060149 Jul 28 02:26:14.186031 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 455/914] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:26:14.191690 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:14.192382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:14.198816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:14.202838 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:14.203346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:14.204134 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:14.204574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:14.212050 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5e3b528c-2778-440e-acd6-1653b0d91781 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.232048 Jul 28 02:26:14.213554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 460/915] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:13 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:14.273440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce471a0d92f4985b7d071078f30f1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a88dd0d514e9080b5355da878b406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:14.280982 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a4f3d91-d434-4df6-b925-6d6cc5842bd9 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 200 len: 1219 microversion: 2.1 time: 0.093820 Jul 28 02:26:14.281542 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 456/916] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:14 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:15.235038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:15.235702 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:15.238285 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:15.244261 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:15.244711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:15.246017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:15.246973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:15.251864 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:15.306017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:15.307284 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] [instance: 734a7df7-1d42-44b2-a43e-f71f1811a773] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:15.316250 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:15.316992 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:15.317759 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:15.318183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:15.333805 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] HTTP exception thrown: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Request method failure captured: Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 HTTP/1.1 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fJ0Xqvdl4ueggBaNrsYNipdSNYmWDNpmAzQTJd-ebROIYXSHRwpqPKpy3ViYdzdiOcAL695VowboveyGqFPnPWU4mWGkm-ISQesjJNmf0Jixu6QLgTSPcgCS1mQTHvy4Dv6q0I6huqVLnKlx0t5rVl5sLZA4a9dUxsvJAbXi3Or_v0 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 723a88dd0d514e9080b5355da878b406 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestShelveInstance-1916674979 Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:26:15.335440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/723a88dd0d514e9080b5355da878b406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/723a88dd0d514e9080b5355da878b406"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/723a88dd0d514e9080b5355da878b406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_723a88dd0d514e9080b5355da878b406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestShelveInstance-1916674979 Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 723a88dd0d514e9080b5355da878b406 Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestShelveInstance-1916674979 Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-TestShelveInstance-1916674979-project Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 1ce471a0d92f4985b7d071078f30f1bc Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestShelveInstance-1916674979-project Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. Jul 28 02:26:15.337037 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '734a7df7-1d42-44b2-a43e-f71f1811a773'} Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:26:15.337868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. Jul 28 02:26:15.339137 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:26:15.341580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Returning 404 to user: Instance 734a7df7-1d42-44b2-a43e-f71f1811a773 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:26:15.342423 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb3a5bd2-2d27-4e06-82e8-1945c5217ecf tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773" status: 404 len: 111 microversion: 2.1 time: 0.040407 Jul 28 02:26:15.344910 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 457/917] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:15 2022] GET /compute/v2.1/servers/734a7df7-1d42-44b2-a43e-f71f1811a773 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:26:15.408730 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:15.416829 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8766e5b2-78fc-4595-a79f-28e47497c6a5 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.185791 Jul 28 02:26:15.417718 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 461/918] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:15 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:15.517492 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fec48074-cfb9-42fb-9df8-bbbf6b0d6a37 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] Calling method '.version_select at 0x7efc52c8e820>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:15.544364 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fec48074-cfb9-42fb-9df8-bbbf6b0d6a37 tempest-TestShelveInstance-1916674979 tempest-TestShelveInstance-1916674979-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-672939744" status: 202 len: 0 microversion: 2.1 time: 0.030703 Jul 28 02:26:15.544920 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 458/919] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:26:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-672939744 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:26:16.438341 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:16.438928 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:16.446258 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:16.446708 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:16.447480 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:16.447917 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:16.604066 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:16.615895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bc078048-d8f5-49d8-887d-6bcc49d5ed4e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.181308 Jul 28 02:26:16.616886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 462/920] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:16 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:17.638230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:17.638836 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:17.649073 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:17.649841 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:17.650823 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:17.651259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:18.215914 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:18.225000 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eef7d203-2db0-403f-80f3-73aa9f9c36f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.591491 Jul 28 02:26:18.225603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 459/921] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:17 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:19.247688 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:19.248459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:19.255387 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:19.255844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:19.256621 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:19.257091 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:19.512403 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:19.522045 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c9b0018-1148-44db-9d8d-79ba00877c99 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.278620 Jul 28 02:26:19.522869 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 463/922] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:19 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:20.544331 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:20.544849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:20.551904 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:20.552341 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:20.553119 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:20.553548 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:20.742794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:20.750721 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bd357afc-0494-4efb-9e18-dc282263c726 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.210716 Jul 28 02:26:20.751294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 460/923] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:20 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:21.778680 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:21.779292 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:21.788978 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:21.789425 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:21.790190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:21.790710 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:21.964722 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:21.973490 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-679563ae-aa22-4df3-90b1-f100757ddda6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.198701 Jul 28 02:26:21.974794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 464/924] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:21 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:23.003524 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:23.004249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:23.011660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:23.012346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:23.013143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:23.013640 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:23.159087 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:23.167439 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f795547a-416c-4f69-8c16-2077d4f80514 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.168194 Jul 28 02:26:23.168648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 461/925] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:22 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:26:24.190768 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:24.191385 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:24.197886 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:24.198335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:24.199093 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:24.199528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:24.330438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:24.338546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bbdb5d13-fa03-4bf3-9f21-f383a3049d01 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.151720 Jul 28 02:26:24.339355 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 465/926] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:24 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:25.360467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:25.361109 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:25.368700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:25.369175 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:25.369933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:25.370369 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:25.506342 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:25.514187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-655339a3-3d53-4348-9372-a30e2017cbd6 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.157521 Jul 28 02:26:25.514751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 462/927] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:25 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:26.536427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:26.537113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:26.543834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:26.544277 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:26.545253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:26.545694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:26.681721 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:26.690328 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d56a8521-7138-4da1-8ce9-d067d2d9f727 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1725 microversion: 2.1 time: 0.157657 Jul 28 02:26:26.690842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 466/928] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:26 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:26.972117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40f176e9-71db-4a3d-a290-1b4fc7c11aed", "device": "/dev/sdb"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:26.975040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:26.981844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:26.982293 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:26.983058 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:26.983493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:27.226167 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bb06a7be-e9a5-497e-81d9-407abf6bd298 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "POST /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258107 Jul 28 02:26:27.226776 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 463/929] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:26:26 2022] POST /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:27.712263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:27.713068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:27.722256 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:27.723088 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:27.724294 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:27.724937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:27.901652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:27.916159 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06ccc78a-1409-4b46-93af-dec810d0d6fe tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1702 microversion: 2.1 time: 0.208171 Jul 28 02:26:27.922110 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 467/930] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:27 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1702 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:27.944018 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7025e37e-82d4-43fa-84ab-a9d01bf51b62 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:27.951041 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7025e37e-82d4-43fa-84ab-a9d01bf51b62 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:27.951494 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7025e37e-82d4-43fa-84ab-a9d01bf51b62 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:27.978671 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7025e37e-82d4-43fa-84ab-a9d01bf51b62 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Going to try to start instance {{(pid=117788) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 02:26:28.021325 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7025e37e-82d4-43fa-84ab-a9d01bf51b62 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action" status: 202 len: 0 microversion: 2.1 time: 0.083296 Jul 28 02:26:28.022048 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 464/931] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:26:27 2022] POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 02:26:28.030514 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:28.031601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:28.038629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:28.039098 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:28.039975 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:28.040405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:28.491245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:28.499270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0fffefa4-d809-4631-ac58-57b592ecc062 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1711 microversion: 2.1 time: 0.472606 Jul 28 02:26:28.500077 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 468/932] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:28 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1711 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:29.521441 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:29.522143 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:29.528234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:29.528676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:29.529466 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:29.529893 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:29.661478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:29.669328 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2093e4cb-2e6e-4fa1-bd50-7f99c83c47ae tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1711 microversion: 2.1 time: 0.152630 Jul 28 02:26:29.669882 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 465/933] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:29 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:30.074725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-88102014", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-822063328", "security_groups": [{"name": "tempest-secgroup-smoke-115564651"}], "block_device_mapping_v2": [{"uuid": "bcf8c842-1dd7-4e9c-aa1c-3a9a0b95cc55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a862076-171d-4686-a6b7-e646e42fd313"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:30.188840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] validate_networks() for [('6a862076-171d-4686-a6b7-e646e42fd313', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:26:30.569966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:26:30.570384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:26:30.570854 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:26:30.571259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:26:30.571662 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:26:30.580414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:30.580855 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:30.581675 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:30.582128 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:30.598800 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:26:30.602711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Getting quotas for user dc1b1c277f9d4f9d8224a03201d3bb38 and project 551ad4a52e754c83a0215409f09a21a8. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:26:30.659031 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:26:30.661143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcf8c842-1dd7-4e9c-aa1c-3a9a0b95cc55',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:26:30.691487 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:30.692122 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:30.698676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:30.699126 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:30.699899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:30.700337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:30.799092 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a3b954fe-7e03-4f8e-b7a7-d6b751e1be17 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.727626 Jul 28 02:26:30.800411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 469/934] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:26:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:26:30.810515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f6fd37aa-fcb9-44b7-94cb-1116cb747868 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:30.811363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f6fd37aa-fcb9-44b7-94cb-1116cb747868 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:30.882910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f6fd37aa-fcb9-44b7-94cb-1116cb747868 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:30.886072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:30.891024 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f6fd37aa-fcb9-44b7-94cb-1116cb747868 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1092 microversion: 2.1 time: 0.084291 Jul 28 02:26:30.891663 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 470/935] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:30 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1092 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:26:30.899886 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c73b99ac-fdf3-4966-8377-55550a1b9c0e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1715 microversion: 2.1 time: 0.212953 Jul 28 02:26:30.900455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 466/936] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:30 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1715 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:26:31.911475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:31.912100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:31.918871 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:31.919331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:31.920102 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:31.920537 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:31.999248 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:32.007567 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a4f7865b-486e-4643-ac1f-aefa00a744c6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1208 microversion: 2.1 time: 0.099966 Jul 28 02:26:32.008153 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 471/937] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:31 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:33.029604 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:33.030842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:33.038658 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:33.039105 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:33.040047 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:33.040653 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:33.135231 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-f581e2a9-cd38-4032-9277-ac4da6a7b480 req-edbe30c4-815d-4ff6-b335-be8d95f0a5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d634ea-8eeb-4280-afef-f5689e3cceb6", "tag": "811f35df-5ed8-468d-a85d-74f5ac417103"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:33.148273 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f581e2a9-cd38-4032-9277-ac4da6a7b480 req-edbe30c4-815d-4ff6-b335-be8d95f0a5a8 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:33.153286 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-f581e2a9-cd38-4032-9277-ac4da6a7b480 req-edbe30c4-815d-4ff6-b335-be8d95f0a5a8 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:33.165322 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-f581e2a9-cd38-4032-9277-ac4da6a7b480 req-edbe30c4-815d-4ff6-b335-be8d95f0a5a8 service nova] Creating event network-changed:811f35df-5ed8-468d-a85d-74f5ac417103 for instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 on hv-cinder-79987 Jul 28 02:26:33.170504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-f581e2a9-cd38-4032-9277-ac4da6a7b480 req-edbe30c4-815d-4ff6-b335-be8d95f0a5a8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039644 Jul 28 02:26:33.171468 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 472/938] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:33.239344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:33.247210 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-99b831f6-c207-48f1-b8b6-ff940adfc91f tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1275 microversion: 2.1 time: 0.222077 Jul 28 02:26:33.247937 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 467/939] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:33 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1275 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:34.269080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:34.269701 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:34.276472 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:34.277224 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:34.277991 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:34.278753 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:34.414952 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:34.422351 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bbcad56e-fa63-4fd6-a272-ba15cf2cb627 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.158392 Jul 28 02:26:34.422949 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 473/940] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:34 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:35.443700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:35.444309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:35.450826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:35.451276 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:35.452028 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:35.452461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:35.592556 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:35.600609 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-468bc51f-e81b-4de9-a5fa-0148a7a51e8b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.160793 Jul 28 02:26:35.601224 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 468/941] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:35 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:36.622181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:36.622913 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:36.630259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:36.630709 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:36.631521 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:36.631959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:36.769123 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:36.776585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce017bea-85ae-4e71-a5b3-aac86e26d3a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.158607 Jul 28 02:26:36.777181 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 474/942] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:36 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:37.797991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:37.798590 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:37.805625 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:37.806084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:37.806809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:37.807238 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:37.937166 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:37.944770 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-df936bd3-f405-4d22-aa21-5e6364402d40 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.150670 Jul 28 02:26:37.945386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 469/943] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:37 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:38.965649 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:38.966252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:38.972860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:38.973339 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:38.974095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:38.974522 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:39.117134 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:39.124746 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ee4fac3-8a2d-4b59-95ff-1797b3c25016 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.163242 Jul 28 02:26:39.125391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 475/944] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:38 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:40.146939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:40.147550 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:40.154124 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:40.154579 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:40.155345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:40.155840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:40.160088 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:40.289273 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:40.296682 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a0d864d1-a1c2-4536-a7ce-4ae019916c77 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.154334 Jul 28 02:26:40.297277 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 470/945] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:40 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:41.318414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:41.319054 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:41.321475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:41.322209 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:41.327738 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:41.328188 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:41.329019 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:41.329459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:41.462194 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:41.469844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-445cb089-d2af-4714-b13e-3d924c29e0a8 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.155967 Jul 28 02:26:41.470680 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 476/946] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:41 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:42.493756 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:42.494368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:42.501376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:42.501828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:42.503386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:42.503754 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:42.650004 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:42.657780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b46daf5a-467d-4fc1-b4b2-98115729d93e tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.168858 Jul 28 02:26:42.658427 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 471/947] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:42 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:43.680007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:43.680610 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:43.687101 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:43.687543 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:43.688293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:43.688725 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:43.817447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:43.824816 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e9e46585-2087-4e14-acf9-fbdc5eb96af6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.148668 Jul 28 02:26:43.825400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 477/948] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:43 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:44.845676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:44.846371 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:44.848801 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:44.854811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:44.855249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:44.856001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:44.856429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:44.989394 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:44.996769 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bbaa5977-a354-4cd7-84d5-28aeefbbfeca tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.154945 Jul 28 02:26:44.997365 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 472/949] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:44 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:46.020080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:46.020755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:46.023143 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:46.028430 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:46.028908 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:46.029663 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:46.030096 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:46.035389 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=88 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:26:46.164593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:46.172040 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9481bd99-bbdc-44f6-893f-38162f05ea63 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.156939 Jul 28 02:26:46.172600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 478/950] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:46 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:46.834562 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a9df97cb-686a-4e4f-b80c-2fb3b575b7c1 req-167e2c1e-b7dc-4843-aa93-92d962063cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d634ea-8eeb-4280-afef-f5689e3cceb6", "name": "network-vif-plugged", "status": "completed", "tag": "811f35df-5ed8-468d-a85d-74f5ac417103"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:46.846868 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a9df97cb-686a-4e4f-b80c-2fb3b575b7c1 req-167e2c1e-b7dc-4843-aa93-92d962063cf6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:46.847358 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a9df97cb-686a-4e4f-b80c-2fb3b575b7c1 req-167e2c1e-b7dc-4843-aa93-92d962063cf6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:46.859155 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a9df97cb-686a-4e4f-b80c-2fb3b575b7c1 req-167e2c1e-b7dc-4843-aa93-92d962063cf6 service nova] Creating event network-vif-plugged:811f35df-5ed8-468d-a85d-74f5ac417103 for instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 on hv-cinder-79987 Jul 28 02:26:46.865482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a9df97cb-686a-4e4f-b80c-2fb3b575b7c1 req-167e2c1e-b7dc-4843-aa93-92d962063cf6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034515 Jul 28 02:26:46.866294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 473/951] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:47.191997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:47.192603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:47.199136 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:47.199577 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:47.200327 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:47.200760 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:47.333842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:47.341401 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2c1a9d8e-1775-43aa-bee7-3bef655ba0e6 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1263 microversion: 2.1 time: 0.153433 Jul 28 02:26:47.341965 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 479/952] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:47 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:48.364257 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:48.364997 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:48.371346 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:48.371797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:48.372553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:48.373209 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:48.504317 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:48.511771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11feb05b-0628-4b72-9edf-8442806b69ab tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1450 microversion: 2.1 time: 0.153409 Jul 28 02:26:48.512336 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 474/953] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:48 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:48.532155 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:48.532765 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:48.539863 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:48.540314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:48.541103 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:48.541546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:48.675794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:48.683278 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f17618c6-3266-4269-bb20-fd3d6a947085 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1450 microversion: 2.1 time: 0.155043 Jul 28 02:26:48.683840 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 480/954] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:48 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:49.949074 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:49.949629 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:49.957032 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:49.957580 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:49.958418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:49.958923 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:50.042240 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lazy-loading 'services' on Instance uuid 74947e5c-adef-420f-996c-1cc87cda6bb9 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:26:50.121017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b19fcfe5-41cc-42a4-bfd8-0cdde7124a6b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9/os-volume_attachments/40f176e9-71db-4a3d-a290-1b4fc7c11aed" status: 202 len: 0 microversion: 2.1 time: 0.175618 Jul 28 02:26:50.121620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 475/955] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:26:49 2022] DELETE /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9/os-volume_attachments/40f176e9-71db-4a3d-a290-1b4fc7c11aed => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:26:50.708400 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c8e55ec2-f7f9-492d-9053-bcd40ae0d31c req-d8552320-b5e9-4150-a21e-de15667276d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d634ea-8eeb-4280-afef-f5689e3cceb6", "tag": "811f35df-5ed8-468d-a85d-74f5ac417103"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:50.719363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c8e55ec2-f7f9-492d-9053-bcd40ae0d31c req-d8552320-b5e9-4150-a21e-de15667276d0 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:50.719808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c8e55ec2-f7f9-492d-9053-bcd40ae0d31c req-d8552320-b5e9-4150-a21e-de15667276d0 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:50.731375 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c8e55ec2-f7f9-492d-9053-bcd40ae0d31c req-d8552320-b5e9-4150-a21e-de15667276d0 service nova] Creating event network-changed:811f35df-5ed8-468d-a85d-74f5ac417103 for instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 on hv-cinder-79987 Jul 28 02:26:50.737438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c8e55ec2-f7f9-492d-9053-bcd40ae0d31c req-d8552320-b5e9-4150-a21e-de15667276d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033347 Jul 28 02:26:50.738036 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 481/956] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:51.265020 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:51.265692 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:51.272395 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:51.272844 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:51.273648 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:51.274086 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:51.301946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:26:51.379344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-09dddf38-af21-4d60-9d5f-8a89ee3af565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "DELETE /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 204 len: 0 microversion: 2.1 time: 0.118678 Jul 28 02:26:51.379857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 476/957] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:26:51 2022] DELETE /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:26:51.388899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:51.389616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:51.395929 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:51.396391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:51.397290 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:51.397640 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:51.534234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:51.542412 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0e0933ff-8f1f-4ad3-84d8-174d7a2dd065 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1513 microversion: 2.1 time: 0.157669 Jul 28 02:26:51.543080 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 482/958] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:51 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:52.565795 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:52.566608 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:52.573187 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:52.573637 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:52.574429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:52.574863 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:52.707587 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:52.715285 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-275a69d1-8678-43de-a081-65ee86701f98 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1513 microversion: 2.1 time: 0.153876 Jul 28 02:26:52.715909 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 477/959] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:52 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:53.639489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1ba3f65a-e50e-4f8a-af6b-7ecb138844a1 req-b0bafb83-d8b9-40e7-89a9-9c2516daea8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74947e5c-adef-420f-996c-1cc87cda6bb9", "name": "network-vif-deleted", "tag": "7aef719b-6297-463f-b7ff-bdd0663809fd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:26:53.653585 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1ba3f65a-e50e-4f8a-af6b-7ecb138844a1 req-b0bafb83-d8b9-40e7-89a9-9c2516daea8d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:53.654023 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1ba3f65a-e50e-4f8a-af6b-7ecb138844a1 req-b0bafb83-d8b9-40e7-89a9-9c2516daea8d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:53.667833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1ba3f65a-e50e-4f8a-af6b-7ecb138844a1 req-b0bafb83-d8b9-40e7-89a9-9c2516daea8d service nova] Creating event network-vif-deleted:7aef719b-6297-463f-b7ff-bdd0663809fd for instance 74947e5c-adef-420f-996c-1cc87cda6bb9 on hv-cinder-79987 Jul 28 02:26:53.673196 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1ba3f65a-e50e-4f8a-af6b-7ecb138844a1 req-b0bafb83-d8b9-40e7-89a9-9c2516daea8d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 Jul 28 02:26:53.673986 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 483/960] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:26:53.735603 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:53.736199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:53.743618 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:53.744068 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:53.744830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:53.745294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:53.777695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:53.778145 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:53.778591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lazy-loading 'fault' on Instance uuid 74947e5c-adef-420f-996c-1cc87cda6bb9 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:26:53.819808 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:26:53.827172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2db346cc-0c7c-48e4-bc4e-926c7126100f tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 200 len: 1309 microversion: 2.1 time: 0.095471 Jul 28 02:26:53.827737 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 478/961] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:53 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:26:54.850334 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:26:54.851038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 74947e5c-adef-420f-996c-1cc87cda6bb9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:26:54.857895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:54.858348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:54.859114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:26:54.859556 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:26:54.874595 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] HTTP exception thrown: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Request method failure captured: Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 HTTP/1.1 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fOxxPsYCXoWOoL_kQoHu8mkaf3dA4J0gmkjILG9Ep2Kb5qf_H23J7BAACJF-un2IRtd0nnZVtA57IwfgIq79LGPQG8xvKKWENZ5tm7qd94bmRQwAKyKtxL0hE-1wD9e3SeGKVQTa3OXV9gXIJfCbxIAzb7okfCvcdU2Um6n4Q5wCR4 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: a0cbe4e537bf4a3295d73105f90ec4b8 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:26:54.876242 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: a0cbe4e537bf4a3295d73105f90ec4b8 Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotTestJSON-42341968-project Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: c83fc2f15859437faff8616fb7de3117 Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotTestJSON-42341968-project Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. Jul 28 02:26:54.878584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '74947e5c-adef-420f-996c-1cc87cda6bb9'} Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:26:54.879547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. Jul 28 02:26:54.881343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:26:54.882528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Returning 404 to user: Instance 74947e5c-adef-420f-996c-1cc87cda6bb9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:26:54.882528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-708a1bd0-a7ef-4e9d-a969-6d3af70071b3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9" status: 404 len: 111 microversion: 2.1 time: 0.032999 Jul 28 02:26:54.882528 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 484/962] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:26:54 2022] GET /compute/v2.1/servers/74947e5c-adef-420f-996c-1cc87cda6bb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:27:03.732645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-253926674", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "networks": [{"uuid": "3916ebe1-b0fe-4005-b8f0-849d68eba863"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:03.784201 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] validate_networks() for [('3916ebe1-b0fe-4005-b8f0-849d68eba863', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:27:03.824142 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:04.176586 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:27:04.177066 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:27:04.177543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:27:04.177955 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:27:04.178368 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:27:04.187181 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:04.187628 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:04.188426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:04.188865 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:04.206728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Getting quotas for project a0cbe4e537bf4a3295d73105f90ec4b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:27:04.210717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Getting quotas for user c83fc2f15859437faff8616fb7de3117 and project a0cbe4e537bf4a3295d73105f90ec4b8. Resources: {'instances', 'ram', 'cores'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:27:04.222457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:27:04.224679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:27:04.271128 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-384996b4-5c75-47e3-9d4f-e6a9740d8d39 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541895 Jul 28 02:27:04.271709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 479/963] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:27:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 02:27:04.282499 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cb1b17da-4e1e-4d26-b86b-8894a3208dc5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:04.283114 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cb1b17da-4e1e-4d26-b86b-8894a3208dc5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:04.337959 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cb1b17da-4e1e-4d26-b86b-8894a3208dc5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:04.344912 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cb1b17da-4e1e-4d26-b86b-8894a3208dc5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1218 microversion: 2.1 time: 0.066311 Jul 28 02:27:04.346107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 485/964] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:04 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:27:05.366700 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:05.367309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:05.373757 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:05.374199 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:05.374947 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:05.375378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:05.444991 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:05.453055 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b8f431ee-73a5-449c-80fd-8e480b94db8e tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1276 microversion: 2.1 time: 0.090259 Jul 28 02:27:05.459363 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 480/965] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:05 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:06.476405 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:06.477130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:06.479174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=29 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:06.485135 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:06.485664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:06.486524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:06.487584 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:06.517822 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a5f8db7b-967b-4101-830b-412523f2cc17 req-a7a49c2d-eb2b-4622-adc9-a2a943311e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874df9bd-37f7-4c70-83f9-1b39d61bd6f5", "tag": "add884a2-8e25-447b-b8bd-2389dcea0a9e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:06.530803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a5f8db7b-967b-4101-830b-412523f2cc17 req-a7a49c2d-eb2b-4622-adc9-a2a943311e9d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:06.531245 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a5f8db7b-967b-4101-830b-412523f2cc17 req-a7a49c2d-eb2b-4622-adc9-a2a943311e9d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:06.544053 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a5f8db7b-967b-4101-830b-412523f2cc17 req-a7a49c2d-eb2b-4622-adc9-a2a943311e9d service nova] Creating event network-changed:add884a2-8e25-447b-b8bd-2389dcea0a9e for instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 on hv-cinder-79987 Jul 28 02:27:06.556141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a5f8db7b-967b-4101-830b-412523f2cc17 req-a7a49c2d-eb2b-4622-adc9-a2a943311e9d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043038 Jul 28 02:27:06.557111 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 481/966] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:27:06.735715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:06.743865 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-730ef693-65c7-494c-ada2-ce97f7960b68 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.272514 Jul 28 02:27:06.744437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 486/967] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:06 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:07.765663 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:07.766356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:07.772842 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:07.773323 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:07.774083 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:07.774518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:07.906003 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:07.914309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5c4bb37-4da7-493d-8391-abedd048b76d tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.153314 Jul 28 02:27:07.914896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 482/968] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:07 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:08.935695 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:08.936266 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:08.942867 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:08.943317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:08.944093 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:08.944526 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:09.075729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:09.083897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-08c71859-b122-44ab-b7b5-67a5b97b2615 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.152207 Jul 28 02:27:09.084456 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 487/969] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:08 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:10.104899 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:10.105554 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:10.112036 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:10.112478 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:10.113254 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:10.113683 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:10.241014 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:10.248360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0f5fd838-3860-4b04-ab26-be825ea65fc9 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.147360 Jul 28 02:27:10.248946 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 483/970] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:10 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:11.269974 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:11.270713 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:11.277217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:11.277668 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:11.278442 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:11.278881 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:11.447792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:11.456379 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2a9d94cd-7b92-4ca0-b36a-0ad79b1d89d3 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.190470 Jul 28 02:27:11.456973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 488/971] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:11 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:12.477337 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:12.477945 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:12.484338 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:12.484780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:12.485728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:12.486179 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:12.625592 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:12.633065 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a284c2d2-7c22-4780-96a3-fae2b29361b7 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.159557 Jul 28 02:27:12.633632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 484/972] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:12 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:12.972682 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e649a3ac-b326-4103-9f7c-3f072829a11d req-96573f89-f701-4a5c-974b-07a817654d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df9bd-37f7-4c70-83f9-1b39d61bd6f5", "name": "network-vif-plugged", "status": "completed", "tag": "add884a2-8e25-447b-b8bd-2389dcea0a9e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:12.982506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e649a3ac-b326-4103-9f7c-3f072829a11d req-96573f89-f701-4a5c-974b-07a817654d6b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:12.982944 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e649a3ac-b326-4103-9f7c-3f072829a11d req-96573f89-f701-4a5c-974b-07a817654d6b service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:12.994734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e649a3ac-b326-4103-9f7c-3f072829a11d req-96573f89-f701-4a5c-974b-07a817654d6b service nova] Creating event network-vif-plugged:add884a2-8e25-447b-b8bd-2389dcea0a9e for instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 on hv-cinder-79987 Jul 28 02:27:12.999794 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e649a3ac-b326-4103-9f7c-3f072829a11d req-96573f89-f701-4a5c-974b-07a817654d6b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Jul 28 02:27:13.000505 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 489/973] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:27:13.654822 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:13.655434 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:13.662334 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:13.662780 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:13.663532 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:13.663968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:13.796293 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:13.804716 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-68de0b37-5f7a-46fe-9576-bc7d8116f060 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1318 microversion: 2.1 time: 0.153748 Jul 28 02:27:13.805379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 485/974] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:13 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:14.250182 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:14.250711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:14.257085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:14.257531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:14.258294 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:14.259448 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:14.340259 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lazy-loading 'services' on Instance uuid bb7852b5-c448-4c73-8090-8c75c15d6900 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:27:14.343764 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:14.413397 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-61a81215-fbb3-4d25-b7c6-8568100c6581 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments/e8f6d70e-de62-4b77-a6b1-9c9234ee8eb9" status: 202 len: 0 microversion: 2.1 time: 0.167928 Jul 28 02:27:14.413995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 490/975] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:27:14 2022] DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments/e8f6d70e-de62-4b77-a6b1-9c9234ee8eb9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:27:14.826527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:14.827394 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:14.830513 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:14.831829 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:14.838497 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:14.838943 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:14.839762 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:14.840194 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:14.973918 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:14.981197 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7d12420-c879-42a9-a0d3-b4f53fc13731 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1507 microversion: 2.1 time: 0.159369 Jul 28 02:27:14.981756 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 486/976] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:14 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:15.002415 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c24e350f-13bd-49d7-88e8-c1b09b205d04", "device": "/dev/sdb"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:15.006301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:15.012473 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:15.012941 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:15.013696 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:15.014127 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:15.317665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4310ce50-630e-4cc2-a7b1-613a2e159ecc tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "POST /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319455 Jul 28 02:27:15.318360 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 491/977] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:27:14 2022] POST /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:27:16.600775 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c48e27b-3d18-4a9a-be4f-1c28769cf736 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:16.603272 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:16.609327 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c48e27b-3d18-4a9a-be4f-1c28769cf736 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:16.609857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c48e27b-3d18-4a9a-be4f-1c28769cf736 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:16.634366 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c48e27b-3d18-4a9a-be4f-1c28769cf736 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Going to try to stop instance {{(pid=117788) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 02:27:16.679132 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c48e27b-3d18-4a9a-be4f-1c28769cf736 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action" status: 202 len: 0 microversion: 2.1 time: 0.082473 Jul 28 02:27:16.679710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 487/978] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:27:16 2022] POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:27:16.688427 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:16.689179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:16.691933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=30 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:16.697485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:16.697989 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:16.698745 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:16.699174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:16.832325 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:16.840338 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b16de84d-d4f1-450c-ac64-f28b1b7885d1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.156205 Jul 28 02:27:16.840924 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 492/979] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:16 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:17.864156 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:17.864849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:17.870983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:17.871424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:17.872172 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:17.872599 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:18.005412 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:18.012679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-56983369-19ae-41b8-9211-fe6e236127e1 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.153781 Jul 28 02:27:18.013264 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 488/980] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:17 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:19.033997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:19.034609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:19.041386 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:19.041863 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:19.042657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:19.043087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:19.173180 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:19.181214 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e72dab4f-8e7f-4f35-821b-b9a1aad22f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.151082 Jul 28 02:27:19.181780 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 493/981] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:19 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:20.203518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:20.204129 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:20.211222 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:20.211939 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:20.212692 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:20.213152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:20.344089 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:20.352360 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a22772db-e9ae-43e0-b977-6147aa0b743a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.152740 Jul 28 02:27:20.352969 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 489/982] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:20 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:21.373197 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:21.373821 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:21.380835 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:21.381314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:21.382202 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:21.382638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:21.512811 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:21.520687 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-99f5d105-13fe-4294-8375-411913d3b12d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.151489 Jul 28 02:27:21.521269 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 494/983] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:21 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:22.542714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:22.543376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:22.550098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:22.550571 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:22.551326 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:22.551755 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:22.682189 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:22.689970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2f61988f-b93d-407d-83c5-4f2e36294b42 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.150984 Jul 28 02:27:22.691170 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 490/984] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:22 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:23.710890 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:23.712525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:23.719359 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:23.719801 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:23.720599 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:23.721061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:23.853335 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:23.860839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ef1a9ce-4588-40c0-aa4d-7c5c3459a3f0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.153875 Jul 28 02:27:23.861437 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 495/985] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:23 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:24.882689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:24.883291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:24.889775 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:24.890217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:24.890965 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:24.891393 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:25.026927 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:25.034347 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-193462a0-bf6b-48c1-b2bd-d09364b06218 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.156183 Jul 28 02:27:25.034930 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 491/986] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:24 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:26.055475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:26.056079 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:26.062732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:26.063362 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:26.064332 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:26.065014 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:26.197293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:26.204665 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-93719f87-b3be-4959-814d-3713108843eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1679 microversion: 2.1 time: 0.153023 Jul 28 02:27:26.205251 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 496/987] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:26 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:27.230744 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:27.231578 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:27.238539 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:27.239477 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:27.240261 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:27.240748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:27.377429 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:27.384970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07082eed-0b60-4912-8370-3f72e8d34c9b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1656 microversion: 2.1 time: 0.158023 Jul 28 02:27:27.385538 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 492/988] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:27 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:27.405783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06d585d8-ef2c-4855-aca2-acb4b8c33072 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:27.413008 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06d585d8-ef2c-4855-aca2-acb4b8c33072 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:27.413462 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06d585d8-ef2c-4855-aca2-acb4b8c33072 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:27.475656 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06d585d8-ef2c-4855-aca2-acb4b8c33072 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Going to try to start instance {{(pid=117787) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 02:27:27.516280 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06d585d8-ef2c-4855-aca2-acb4b8c33072 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action" status: 202 len: 0 microversion: 2.1 time: 0.114198 Jul 28 02:27:27.516896 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 497/989] 10.222.0.40 () {60 vars in 1278 bytes} [Thu Jul 28 02:27:27 2022] POST /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:27:27.525804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:27.526413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:27.532309 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:27.532926 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:27.533809 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:27.534291 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:27.678574 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:27.686022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e8415cfe-442b-4e64-9d3c-3e5913ad047b tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1665 microversion: 2.1 time: 0.164107 Jul 28 02:27:27.686584 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 493/990] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:27 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:28.709897 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:28.710518 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:28.717107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:28.717562 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:28.718331 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:28.718769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:28.848524 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:28.856081 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-094b3585-fb2b-4d07-bff1-ddcd17131628 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1665 microversion: 2.1 time: 0.151916 Jul 28 02:27:28.856648 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 498/991] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:28 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:29.877430 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:29.878021 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:29.884638 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:29.885120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:29.885871 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:29.886305 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:30.014734 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:30.022821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c9c16140-9da0-43e9-987c-8f67ac1684ab tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1665 microversion: 2.1 time: 0.149349 Jul 28 02:27:30.023383 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 494/992] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:29 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:31.045275 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:31.045933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:31.053007 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:31.053459 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:31.054223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:31.054655 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:31.188722 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:31.197132 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d4e89a19-e33e-4812-815a-d26298d56f49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1665 microversion: 2.1 time: 0.155912 Jul 28 02:27:31.197726 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 499/993] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:31 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:32.219160 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:32.219800 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:32.226352 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:32.226803 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:32.227567 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:32.228002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:32.354426 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:32.357957 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:32.362753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-46b225a9-4ed4-4cf3-b048-b89009d50f70 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1669 microversion: 2.1 time: 0.147700 Jul 28 02:27:32.363319 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 495/994] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:32 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:34.688669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:34.689247 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:34.696536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:34.697016 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:34.697772 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:34.698212 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:34.702148 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:27:34.780943 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lazy-loading 'services' on Instance uuid 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:27:34.854458 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06622e76-c9c1-4455-a4c4-3548d203e7f1 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "DELETE /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5/os-volume_attachments/c24e350f-13bd-49d7-88e8-c1b09b205d04" status: 202 len: 0 microversion: 2.1 time: 0.169554 Jul 28 02:27:34.855095 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 500/995] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:27:34 2022] DELETE /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5/os-volume_attachments/c24e350f-13bd-49d7-88e8-c1b09b205d04 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:27:35.971356 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:35.971870 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:35.981374 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:35.981709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:35.982463 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:35.982891 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:36.008695 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:27:36.082722 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6d34a4a7-6b02-4455-a805-576584ab67a2 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "DELETE /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 204 len: 0 microversion: 2.1 time: 0.114826 Jul 28 02:27:36.083553 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 496/996] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:27:35 2022] DELETE /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:27:36.093139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:36.093831 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:36.100174 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:36.100617 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:36.101404 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:36.101834 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:36.230296 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:36.237710 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6d947f24-8c6e-4638-8b8b-f9a9e34b200b tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1513 microversion: 2.1 time: 0.149419 Jul 28 02:27:36.238279 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 501/997] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:36 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:27:37.261763 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:37.262452 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:37.269006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:37.269455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:37.270262 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:37.270979 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:37.403660 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:37.411185 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07794d5d-d1f2-4023-8587-4eaa9e3f6423 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1513 microversion: 2.1 time: 0.153970 Jul 28 02:27:37.412415 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 497/998] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:37 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:27:38.434343 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:38.434970 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:38.443547 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:38.444035 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:38.444813 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:38.445291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:38.527697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c83fc2f15859437faff8616fb7de3117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cbe4e537bf4a3295d73105f90ec4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:27:38.528632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-59d9dce8-7874-470f-aca8-b89e44c72171 req-238f4611-03ef-4ab6-b3d3-6adeded93794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874df9bd-37f7-4c70-83f9-1b39d61bd6f5", "name": "network-vif-deleted", "tag": "add884a2-8e25-447b-b8bd-2389dcea0a9e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:27:38.536350 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6bf8e5e2-1094-4dc2-85cd-351b1bef8565 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 200 len: 1471 microversion: 2.1 time: 0.108140 Jul 28 02:27:38.537203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 502/999] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:38 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 1471 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:27:38.540784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-59d9dce8-7874-470f-aca8-b89e44c72171 req-238f4611-03ef-4ab6-b3d3-6adeded93794 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:38.542079 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-59d9dce8-7874-470f-aca8-b89e44c72171 req-238f4611-03ef-4ab6-b3d3-6adeded93794 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:38.554188 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-59d9dce8-7874-470f-aca8-b89e44c72171 req-238f4611-03ef-4ab6-b3d3-6adeded93794 service nova] Creating event network-vif-deleted:add884a2-8e25-447b-b8bd-2389dcea0a9e for instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 on hv-cinder-79987 Jul 28 02:27:38.560270 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-59d9dce8-7874-470f-aca8-b89e44c72171 req-238f4611-03ef-4ab6-b3d3-6adeded93794 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035645 Jul 28 02:27:38.561271 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 498/1000] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 02:27:39.559139 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:27:39.559770 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] [instance: 874df9bd-37f7-4c70-83f9-1b39d61bd6f5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:27:39.566263 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:39.566711 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:39.567466 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:27:39.567902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:27:39.581830 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] HTTP exception thrown: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Request method failure captured: Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 HTTP/1.1 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fOxxPsYCXoWOoL_kQoHu8mkaf3dA4J0gmkjILG9Ep2Kb5qf_H23J7BAACJF-un2IRtd0nnZVtA57IwfgIq79LGPQG8xvKKWENZ5tm7qd94bmRQwAKyKtxL0hE-1wD9e3SeGKVQTa3OXV9gXIJfCbxIAzb7okfCvcdU2Um6n4Q5wCR4 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: a0cbe4e537bf4a3295d73105f90ec4b8 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:27:39.583447 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a0cbe4e537bf4a3295d73105f90ec4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: a0cbe4e537bf4a3295d73105f90ec4b8 Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-42341968 Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotTestJSON-42341968-project Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: c83fc2f15859437faff8616fb7de3117 Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotTestJSON-42341968-project Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. Jul 28 02:27:39.585176 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '874df9bd-37f7-4c70-83f9-1b39d61bd6f5'} Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:27:39.586902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. Jul 28 02:27:39.588245 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:27:39.589488 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] Returning 404 to user: Instance 874df9bd-37f7-4c70-83f9-1b39d61bd6f5 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:27:39.589488 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-097a34a4-bdad-448a-9031-6d6b3cb138e5 tempest-VolumesSnapshotTestJSON-42341968 tempest-VolumesSnapshotTestJSON-42341968-project] 10.222.0.40 "GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5" status: 404 len: 111 microversion: 2.1 time: 0.030339 Jul 28 02:27:39.589488 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 503/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:27:39 2022] GET /compute/v2.1/servers/874df9bd-37f7-4c70-83f9-1b39d61bd6f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:28:07.889073 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:28:07.889860 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:28:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:28:11.097484 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:11.099765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:11.102067 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:11.103728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:11.110372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.110849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.111632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.112062 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.143880 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-50d934ea-f983-4466-8ac0-3d49da7e07f8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050627 Jul 28 02:28:11.144424 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 499/1002] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:28:11 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:28:11.206001 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:11.206572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:11.208609 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=23 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:11.209557 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:11.215994 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.216450 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.217238 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.217679 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.244626 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:28:11.318078 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b782f49c-4a57-4a87-9008-e1e7cc13fb9e tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 204 len: 0 microversion: 2.1 time: 0.115742 Jul 28 02:28:11.318654 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 504/1003] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:28:11 2022] DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:28:11.327210 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:11.327811 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:11.333738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.334184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.335184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:11.335610 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:11.846161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:11.853968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b20d4f0e-a051-4844-aee3-12002316a832 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1675 microversion: 2.1 time: 0.530627 Jul 28 02:28:11.854536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 500/1004] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:11 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1675 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:12.877241 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:12.877948 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:12.884391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:12.884839 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:12.886414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:12.886849 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:13.179308 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:13.187729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3fff44c5-dd2c-4c27-a374-21476579dd3f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1675 microversion: 2.1 time: 0.314660 Jul 28 02:28:13.188356 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 505/1005] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:12 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:14.013043 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a6b2e643-07f9-421b-a06c-870fe470e4b7 req-4fde7b1c-9fa2-4851-bb55-9a652fb3cc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7852b5-c448-4c73-8090-8c75c15d6900", "name": "network-vif-deleted", "tag": "5535562d-0c12-47d5-b1c1-dbf26caaa058"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:14.023652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a6b2e643-07f9-421b-a06c-870fe470e4b7 req-4fde7b1c-9fa2-4851-bb55-9a652fb3cc2e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:14.024094 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a6b2e643-07f9-421b-a06c-870fe470e4b7 req-4fde7b1c-9fa2-4851-bb55-9a652fb3cc2e service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:14.040244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a6b2e643-07f9-421b-a06c-870fe470e4b7 req-4fde7b1c-9fa2-4851-bb55-9a652fb3cc2e service nova] Creating event network-vif-deleted:5535562d-0c12-47d5-b1c1-dbf26caaa058 for instance bb7852b5-c448-4c73-8090-8c75c15d6900 on hv-cinder-79987 Jul 28 02:28:14.045968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a6b2e643-07f9-421b-a06c-870fe470e4b7 req-4fde7b1c-9fa2-4851-bb55-9a652fb3cc2e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048983 Jul 28 02:28:14.050085 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 501/1006] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:14.210470 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:14.211733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:14.219781 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:14.220516 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:14.221591 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:14.222255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:14.255805 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:14.256255 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:14.256700 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lazy-loading 'fault' on Instance uuid bb7852b5-c448-4c73-8090-8c75c15d6900 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:28:14.298823 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:14.306439 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1023d878-9f36-4d09-b51c-03a951a6e064 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 200 len: 1328 microversion: 2.1 time: 0.100216 Jul 28 02:28:14.307870 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 506/1007] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:14 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:15.328843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:15.329475 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:15.336141 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:15.336623 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:15.337420 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:15.337857 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:15.352009 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 HTTP/1.1 Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:28:15.354304 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:28:15.355826 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': 'bb7852b5-c448-4c73-8090-8c75c15d6900'} Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:28:15.356747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:28:15.358400 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:15.359885 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:28:15.359885 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0df3ca4a-e7d6-48ea-a17a-cbccf296d6e2 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 404 len: 111 microversion: 2.1 time: 0.031767 Jul 28 02:28:15.359885 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 502/1008] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:15 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:28:15.364638 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f085532c-ba80-4803-b689-209e51a9c0ac tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '.version_select at 0x7efc52d5f670>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:15.391506 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f085532c-ba80-4803-b689-209e51a9c0ac tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124537563" status: 202 len: 0 microversion: 2.1 time: 0.030551 Jul 28 02:28:15.392087 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 507/1009] 10.222.0.40 () {58 vars in 1221 bytes} [Thu Jul 28 02:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124537563 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:28:16.004703 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-32ea82cd-b294-44b7-8898-011b06822d8f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: .version_select at 0x7efc52bd5700>, body: {"keypair": {"name": "tempest-keypair-819470566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0xRRVuG+8D/W6OAEH+smvhAFifOXhSveGtGqbZLjoKdDRwiSMrAKo4hzDsriSStQvrcU4au3tNDOULV51vAi6AiysKwWXukCjD+gM+FNUeH8SJt+UUdf668hSj347xjw=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:16.021178 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-32ea82cd-b294-44b7-8898-011b06822d8f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:28:16.024976 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-32ea82cd-b294-44b7-8898-011b06822d8f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for user 8cec16b821114fc0aa47e8549cacd7d0 and project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:28:16.048527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-32ea82cd-b294-44b7-8898-011b06822d8f tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047646 Jul 28 02:28:16.049335 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 503/1010] 10.222.0.40 () {60 vars in 1159 bytes} [Thu Jul 28 02:28:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:17.321808 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1462776213", "imageRef": "eac3619d-b596-4294-a189-f9495850b020", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2acebb6b-631e-460d-a599-e4c28fc62f29"}], "security_groups": [{"name": "tempest-securitygroup--297343544"}], "key_name": "tempest-keypair-819470566", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:17.423460 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] validate_networks() for [('2acebb6b-631e-460d-a599-e4c28fc62f29', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 02:28:18.069920 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 02:28:18.070341 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 02:28:18.070845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 02:28:18.071252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 02:28:18.071664 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 02:28:18.081374 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:18.081841 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:18.082616 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:18.083052 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:18.101157 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 02:28:18.105303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Getting quotas for user 8cec16b821114fc0aa47e8549cacd7d0 and project 96bfb8cb74ca4919897cf243daafbe2f. Resources: {'instances', 'ram', 'cores'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 02:28:18.116657 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 02:28:18.118966 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac3619d-b596-4294-a189-f9495850b020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 02:28:18.166264 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f51917b-f58a-4e60-91b0-d4191ac29cff tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.849108 Jul 28 02:28:18.167154 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 508/1011] 10.222.0.40 () {60 vars in 1147 bytes} [Thu Jul 28 02:28:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 02:28:18.177804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0089b01f-2ac0-4b32-8647-e22bd7870852 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:18.178408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0089b01f-2ac0-4b32-8647-e22bd7870852 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:18.234386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0089b01f-2ac0-4b32-8647-e22bd7870852 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:18.241248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0089b01f-2ac0-4b32-8647-e22bd7870852 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1237 microversion: 2.1 time: 0.067238 Jul 28 02:28:18.241797 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 504/1012] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:18 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:19.263564 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:19.264190 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:19.270303 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:19.270755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:19.271515 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:19.271955 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:19.334475 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:19.343112 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-857b6d1b-90db-4348-af73-25c8c38e8497 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1295 microversion: 2.1 time: 0.084443 Jul 28 02:28:19.343713 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 509/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:19 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:20.363784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:20.364546 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:20.371171 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:20.371627 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:20.372411 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:20.372850 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:20.514844 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-40c6f9c1-e62e-4e6a-b0e7-8b7cdfec6f14 req-93777c9f-0c4a-4891-b9a2-63e348c151bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e654d8e-747e-43d4-815c-74e0c5fc162a", "tag": "7c4645ae-8832-48dd-a8a3-d5e442eab360"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:20.526984 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-40c6f9c1-e62e-4e6a-b0e7-8b7cdfec6f14 req-93777c9f-0c4a-4891-b9a2-63e348c151bf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:20.527836 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-40c6f9c1-e62e-4e6a-b0e7-8b7cdfec6f14 req-93777c9f-0c4a-4891-b9a2-63e348c151bf service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:20.537558 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:20.545368 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-40c6f9c1-e62e-4e6a-b0e7-8b7cdfec6f14 req-93777c9f-0c4a-4891-b9a2-63e348c151bf service nova] Creating event network-changed:7c4645ae-8832-48dd-a8a3-d5e442eab360 for instance 1e654d8e-747e-43d4-815c-74e0c5fc162a on hv-cinder-79987 Jul 28 02:28:20.546158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-509fcdec-6b83-4c34-9f33-da5a79da9a82 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.186222 Jul 28 02:28:20.546738 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 505/1014] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:20 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:28:20.557470 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-40c6f9c1-e62e-4e6a-b0e7-8b7cdfec6f14 req-93777c9f-0c4a-4891-b9a2-63e348c151bf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067182 Jul 28 02:28:20.561316 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 510/1015] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:21.567804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:21.568407 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:21.575643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:21.576082 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:21.576828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:21.577359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:21.705242 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:21.713323 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-98b83f9b-e31c-48f0-b075-069fbeaf5aa9 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.149130 Jul 28 02:28:21.714147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 506/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:21 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:22.735625 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:22.736320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:22.742546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:22.742993 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:22.743750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:22.744213 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:22.877049 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:22.884514 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f854ff3-156c-4abf-b6d0-3beba7cce697 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.153520 Jul 28 02:28:22.886337 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 511/1017] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:22 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:23.906557 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:23.907189 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:23.913835 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:23.914279 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:23.915035 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:23.915464 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:24.044566 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:24.052022 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1258c54c-c93e-47d5-a7f6-98dc3a78c639 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.149394 Jul 28 02:28:24.052619 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 507/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:23 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:25.073632 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:25.074230 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:25.083113 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:25.083558 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:25.084569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:25.085059 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:25.217848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:25.225183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-edd5618b-0945-4b25-9dcc-d3704e546af8 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.155536 Jul 28 02:28:25.236894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 512/1019] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:25 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:25.300371 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-88ac6320-ec5c-41ca-844d-040364af3a2a req-f99680c5-fd32-4263-af0b-ff9827032c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e654d8e-747e-43d4-815c-74e0c5fc162a", "name": "network-vif-plugged", "status": "completed", "tag": "7c4645ae-8832-48dd-a8a3-d5e442eab360"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:25.311161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-88ac6320-ec5c-41ca-844d-040364af3a2a req-f99680c5-fd32-4263-af0b-ff9827032c4d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:25.311827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-88ac6320-ec5c-41ca-844d-040364af3a2a req-f99680c5-fd32-4263-af0b-ff9827032c4d service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:25.323855 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-88ac6320-ec5c-41ca-844d-040364af3a2a req-f99680c5-fd32-4263-af0b-ff9827032c4d service nova] Creating event network-vif-plugged:7c4645ae-8832-48dd-a8a3-d5e442eab360 for instance 1e654d8e-747e-43d4-815c-74e0c5fc162a on hv-cinder-79987 Jul 28 02:28:25.328698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-88ac6320-ec5c-41ca-844d-040364af3a2a req-f99680c5-fd32-4263-af0b-ff9827032c4d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032111 Jul 28 02:28:25.329321 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 508/1020] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:26.247705 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:26.248317 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:26.254899 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:26.255348 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:26.256108 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:26.256544 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:26.395552 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:26.403016 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cac77e5d-7ef7-454d-ad12-01c9cac33946 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1362 microversion: 2.1 time: 0.160174 Jul 28 02:28:26.403579 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 513/1021] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:26 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:27.424735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:27.425413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:27.431726 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:27.432183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:27.433000 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:27.433440 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:27.565290 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:27.572688 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3d9cf91-d3b6-44c3-adcc-6b10d22caa05 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1548 microversion: 2.1 time: 0.152853 Jul 28 02:28:27.573404 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 509/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:27 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:27.594198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:27.594724 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:27.601119 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:27.601571 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:27.602411 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:27.602904 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:27.687586 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-46352d91-ee5e-4338-87d4-f71d62f2b0eb tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096940 Jul 28 02:28:27.688531 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 514/1023] 10.222.0.40 () {58 vars in 1275 bytes} [Thu Jul 28 02:28:27 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:28.649936 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-8964140c-c8f6-4096-82c4-14a78af909fb req-1c611053-c219-45ef-946e-b6d09e059c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e654d8e-747e-43d4-815c-74e0c5fc162a", "tag": "7c4645ae-8832-48dd-a8a3-d5e442eab360"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:28.655071 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:28.661510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8964140c-c8f6-4096-82c4-14a78af909fb req-1c611053-c219-45ef-946e-b6d09e059c01 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:28.661961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8964140c-c8f6-4096-82c4-14a78af909fb req-1c611053-c219-45ef-946e-b6d09e059c01 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:28.673274 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-8964140c-c8f6-4096-82c4-14a78af909fb req-1c611053-c219-45ef-946e-b6d09e059c01 service nova] Creating event network-changed:7c4645ae-8832-48dd-a8a3-d5e442eab360 for instance 1e654d8e-747e-43d4-815c-74e0c5fc162a on hv-cinder-79987 Jul 28 02:28:28.678511 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-8964140c-c8f6-4096-82c4-14a78af909fb req-1c611053-c219-45ef-946e-b6d09e059c01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032218 Jul 28 02:28:28.679009 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 510/1024] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:30.443784 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:30.444392 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:30.450038 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:30.450530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:30.451768 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-df1e02c0-16e2-4342-817c-6b25f369fc17 req-fdf8f978-f72e-4e22-bb14-ac0d967c97d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d634ea-8eeb-4280-afef-f5689e3cceb6", "tag": "811f35df-5ed8-468d-a85d-74f5ac417103"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:30.458051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:30.458792 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:30.459554 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:30.459983 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:30.461959 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df1e02c0-16e2-4342-817c-6b25f369fc17 req-fdf8f978-f72e-4e22-bb14-ac0d967c97d1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:30.462471 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df1e02c0-16e2-4342-817c-6b25f369fc17 req-fdf8f978-f72e-4e22-bb14-ac0d967c97d1 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:30.474712 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-df1e02c0-16e2-4342-817c-6b25f369fc17 req-fdf8f978-f72e-4e22-bb14-ac0d967c97d1 service nova] Creating event network-changed:811f35df-5ed8-468d-a85d-74f5ac417103 for instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 on hv-cinder-79987 Jul 28 02:28:30.481138 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-df1e02c0-16e2-4342-817c-6b25f369fc17 req-fdf8f978-f72e-4e22-bb14-ac0d967c97d1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035183 Jul 28 02:28:30.482158 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 511/1025] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:30.488129 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:28:30.590421 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c0889ac3-6e36-477f-bd25-b4b719ae4c09 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 204 len: 0 microversion: 2.1 time: 0.146345 Jul 28 02:28:30.591320 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 515/1026] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:28:30 2022] DELETE /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:28:30.600372 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:30.602455 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:30.609922 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:30.610733 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:30.611896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:30.612725 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:30.752980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:30.761244 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5425d238-23ed-445a-9d0b-a8fc85af747c tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1574 microversion: 2.1 time: 0.164896 Jul 28 02:28:30.761812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 512/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:30 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:31.783894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:31.784595 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:31.791163 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:31.791644 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:31.792417 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:31.792848 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:31.933264 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:31.940694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff3331f0-c25a-4cc7-a29b-f0d8769b3280 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1574 microversion: 2.1 time: 0.161042 Jul 28 02:28:31.941293 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 516/1028] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:31 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:32.549344 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-df85dd95-1e77-4029-8b36-8fe6e22cb6d5 req-77611d2a-81ac-4c16-bf93-f86d894569a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d634ea-8eeb-4280-afef-f5689e3cceb6", "name": "network-vif-deleted", "tag": "811f35df-5ed8-468d-a85d-74f5ac417103"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:32.560442 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df85dd95-1e77-4029-8b36-8fe6e22cb6d5 req-77611d2a-81ac-4c16-bf93-f86d894569a2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:32.560896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df85dd95-1e77-4029-8b36-8fe6e22cb6d5 req-77611d2a-81ac-4c16-bf93-f86d894569a2 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:32.572635 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-df85dd95-1e77-4029-8b36-8fe6e22cb6d5 req-77611d2a-81ac-4c16-bf93-f86d894569a2 service nova] Creating event network-vif-deleted:811f35df-5ed8-468d-a85d-74f5ac417103 for instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 on hv-cinder-79987 Jul 28 02:28:32.578125 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-df85dd95-1e77-4029-8b36-8fe6e22cb6d5 req-77611d2a-81ac-4c16-bf93-f86d894569a2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Jul 28 02:28:32.578749 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 513/1029] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:32.963096 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:32.963992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:32.970345 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:32.970779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:32.971570 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:32.972005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:33.003992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:33.004438 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:33.004898 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lazy-loading 'fault' on Instance uuid c0d634ea-8eeb-4280-afef-f5689e3cceb6 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:28:33.044998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:33.052414 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-887d2169-0b7d-42c1-8460-b563c09db784 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 200 len: 1228 microversion: 2.1 time: 0.093536 Jul 28 02:28:33.052998 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 517/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:32 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:34.076771 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:34.077493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: c0d634ea-8eeb-4280-afef-f5689e3cceb6] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:34.083970 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:34.084417 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:34.085217 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:34.085652 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:34.098643 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] HTTP exception thrown: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Request method failure captured: Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 HTTP/1.1 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fJOU0d1J8kf47DrlDP5X7PPqvY8jfBIiFctuSIfxG3Qxiet6m4MFVb_smQ33IZ0nSJOOBqr4eVcRI1_dHssNmR0Ivr1dtikoxvSJL-hZowRvD2lq4YMtZSZr8kSwQ7gawgA9ANFHbvZ-7zQ5KAV9kPZymocApQA_V10u00yUp1bhGc Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:28:34.100249 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: dc1b1c277f9d4f9d8224a03201d3bb38 Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. Jul 28 02:28:34.101732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': 'c0d634ea-8eeb-4280-afef-f5689e3cceb6'} Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:28:34.102666 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. Jul 28 02:28:34.104408 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:34.106010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Returning 404 to user: Instance c0d634ea-8eeb-4280-afef-f5689e3cceb6 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:28:34.106010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e8b149d9-657e-4f64-9afd-9b3bab687e10 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6" status: 404 len: 111 microversion: 2.1 time: 0.030201 Jul 28 02:28:34.106010 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 514/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:34 2022] GET /compute/v2.1/servers/c0d634ea-8eeb-4280-afef-f5689e3cceb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:28:37.151470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-14b63a40-d69d-4bab-99bf-89412f7f52b5 req-183d790c-3980-4c2a-bb66-7158a043c295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1560ee-67e3-4c05-b0e3-e51772b3fad9", "tag": "b509a104-5aca-4c4b-b08e-13aca2f9bbe0"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:37.153919 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:37.155888 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:37.162837 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:37.163380 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:37.164228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:37.164731 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:37.165490 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-14b63a40-d69d-4bab-99bf-89412f7f52b5 req-183d790c-3980-4c2a-bb66-7158a043c295 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:37.165931 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-14b63a40-d69d-4bab-99bf-89412f7f52b5 req-183d790c-3980-4c2a-bb66-7158a043c295 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:37.177433 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-14b63a40-d69d-4bab-99bf-89412f7f52b5 req-183d790c-3980-4c2a-bb66-7158a043c295 service nova] Creating event network-changed:b509a104-5aca-4c4b-b08e-13aca2f9bbe0 for instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 on hv-cinder-79987 Jul 28 02:28:37.182906 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-14b63a40-d69d-4bab-99bf-89412f7f52b5 req-183d790c-3980-4c2a-bb66-7158a043c295 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035004 Jul 28 02:28:37.183493 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 515/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:37.192767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:28:37.207624 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:37.283603 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b73fe7ef-9b88-4afd-bfc9-0312a704690b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 204 len: 0 microversion: 2.1 time: 0.139136 Jul 28 02:28:37.287485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 518/1033] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:28:37 2022] DELETE /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:28:37.295418 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:37.296190 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:37.302957 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:37.304709 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:37.305810 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:37.306620 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:37.464445 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:37.472239 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fc9dfedc-412d-40db-8a3e-e8a274ec719b tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1577 microversion: 2.1 time: 0.182628 Jul 28 02:28:37.472812 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 516/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:37 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:38.494779 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:38.495534 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:38.502546 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:38.502995 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:38.503750 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:38.504183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:38.633435 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:38.641525 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f13aa4d1-ea0d-47bd-b036-5a407fd0f7fd tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1577 microversion: 2.1 time: 0.150969 Jul 28 02:28:38.642090 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 519/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:38 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:39.422120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-83852cab-2e83-4dda-adec-6dcfd662d984 req-bea4666c-a7fc-49f6-b3cf-a2ddfa47673c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1560ee-67e3-4c05-b0e3-e51772b3fad9", "name": "network-vif-deleted", "tag": "b509a104-5aca-4c4b-b08e-13aca2f9bbe0"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:28:39.435382 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83852cab-2e83-4dda-adec-6dcfd662d984 req-bea4666c-a7fc-49f6-b3cf-a2ddfa47673c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:39.435766 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83852cab-2e83-4dda-adec-6dcfd662d984 req-bea4666c-a7fc-49f6-b3cf-a2ddfa47673c service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:39.447110 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-83852cab-2e83-4dda-adec-6dcfd662d984 req-bea4666c-a7fc-49f6-b3cf-a2ddfa47673c service nova] Creating event network-vif-deleted:b509a104-5aca-4c4b-b08e-13aca2f9bbe0 for instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 on hv-cinder-79987 Jul 28 02:28:39.453819 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-83852cab-2e83-4dda-adec-6dcfd662d984 req-bea4666c-a7fc-49f6-b3cf-a2ddfa47673c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036207 Jul 28 02:28:39.454413 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 517/1036] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:28:39.662910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:39.663723 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:39.671090 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:39.671541 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:39.672306 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:39.672741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:39.709240 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:39.709715 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:39.710145 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lazy-loading 'fault' on Instance uuid 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:28:39.753949 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1b1c277f9d4f9d8224a03201d3bb38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551ad4a52e754c83a0215409f09a21a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:28:39.761910 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d59fed68-0f17-413f-9fa2-d33254bd5905 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 200 len: 1230 microversion: 2.1 time: 0.103114 Jul 28 02:28:39.763023 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 520/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:39 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:28:40.785907 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:40.786636 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 6b1560ee-67e3-4c05-b0e3-e51772b3fad9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:40.792894 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:40.793488 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:40.794256 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:40.794689 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:40.807775 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] HTTP exception thrown: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Request method failure captured: Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 HTTP/1.1 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fJOU0d1J8kf47DrlDP5X7PPqvY8jfBIiFctuSIfxG3Qxiet6m4MFVb_smQ33IZ0nSJOOBqr4eVcRI1_dHssNmR0Ivr1dtikoxvSJL-hZowRvD2lq4YMtZSZr8kSwQ7gawgA9ANFHbvZ-7zQ5KAV9kPZymocApQA_V10u00yUp1bhGc Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:28:40.809916 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: dc1b1c277f9d4f9d8224a03201d3bb38 Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. Jul 28 02:28:40.811644 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '6b1560ee-67e3-4c05-b0e3-e51772b3fad9'} Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:28:40.812645 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. Jul 28 02:28:40.814268 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:40.815789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Returning 404 to user: Instance 6b1560ee-67e3-4c05-b0e3-e51772b3fad9 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:28:40.815789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23474b3a-b3c4-45d9-8e25-4e9d8ded9bee tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9" status: 404 len: 111 microversion: 2.1 time: 0.031568 Jul 28 02:28:40.815789 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 518/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:40 2022] GET /compute/v2.1/servers/6b1560ee-67e3-4c05-b0e3-e51772b3fad9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:28:41.265225 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:41.265733 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:41.268250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:41.273662 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:41.274121 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:41.274892 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:41.275329 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:41.291600 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] HTTP exception thrown: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Request method failure captured: Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e HTTP/1.1 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fJOU0d1J8kf47DrlDP5X7PPqvY8jfBIiFctuSIfxG3Qxiet6m4MFVb_smQ33IZ0nSJOOBqr4eVcRI1_dHssNmR0Ivr1dtikoxvSJL-hZowRvD2lq4YMtZSZr8kSwQ7gawgA9ANFHbvZ-7zQ5KAV9kPZymocApQA_V10u00yUp1bhGc Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:28:41.293767 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: dc1b1c277f9d4f9d8224a03201d3bb38 Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.295420 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e'} Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:28:41.296504 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.298051 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.299694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Returning 404 to user: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:28:41.299694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3b34a585-137f-4685-9236-44fa21a5ed4d tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 404 len: 111 microversion: 2.1 time: 0.034413 Jul 28 02:28:41.299694 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 521/1039] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:28:41 2022] DELETE /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:28:41.303717 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:41.304470 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] [instance: 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:28:41.306416 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:41.312301 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:41.312751 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:41.313536 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:28:41.313993 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:28:41.318710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=69 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:28:41.331345 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] HTTP exception thrown: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Request method failure captured: Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e HTTP/1.1 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fJOU0d1J8kf47DrlDP5X7PPqvY8jfBIiFctuSIfxG3Qxiet6m4MFVb_smQ33IZ0nSJOOBqr4eVcRI1_dHssNmR0Ivr1dtikoxvSJL-hZowRvD2lq4YMtZSZr8kSwQ7gawgA9ANFHbvZ-7zQ5KAV9kPZymocApQA_V10u00yUp1bhGc Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:28:41.333147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_551ad4a52e754c83a0215409f09a21a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 551ad4a52e754c83a0215409f09a21a8 Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1246015200 Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: dc1b1c277f9d4f9d8224a03201d3bb38 Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1246015200-project Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.334765 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e'} Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:28:41.335680 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. Jul 28 02:28:41.337174 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:28:41.338515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Returning 404 to user: Instance 5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:28:41.338515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-80d9792c-6cb2-4dc7-bcd8-32ae00015fa4 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e" status: 404 len: 111 microversion: 2.1 time: 0.034627 Jul 28 02:28:41.338515 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 519/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:28:41 2022] GET /compute/v2.1/servers/5bafc4e4-0ab8-4fa7-8c38-d9fd7fbcc34e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:28:42.912652 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-30bb0438-586a-45a9-b9ef-e68b9f0a3d93 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] Calling method '.version_select at 0x7efc580c7820>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:28:42.935489 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-30bb0438-586a-45a9-b9ef-e68b9f0a3d93 tempest-TestVolumeBootPattern-1246015200 tempest-TestVolumeBootPattern-1246015200-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-822063328" status: 202 len: 0 microversion: 2.1 time: 0.026546 Jul 28 02:28:42.936149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 522/1041] 10.222.0.40 () {58 vars in 1260 bytes} [Thu Jul 28 02:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-822063328 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:04.840314 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:04.840896 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:04.843040 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:04.843667 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:04.849878 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:04.850330 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:04.851084 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:04.851518 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:04.875120 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-04bc4d87-c363-4da1-aa14-7743c8e1c43c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/ips" status: 200 len: 146 microversion: 2.1 time: 0.039458 Jul 28 02:29:04.875679 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 520/1042] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:29:04 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:06.202028 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:06.202766 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:06.207683 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5cdb2cc-5b80-4952-bca8-838090a19940"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:29:06.210167 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:06.220549 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:06.221061 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:06.221833 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:06.222268 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:06.455017 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b53f75f0-0a60-48b6-8380-d771859bfb95 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254678 Jul 28 02:29:06.455646 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 523/1043] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:29:06 2022] POST /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:12.923840 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:12.926042 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:12.932486 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:12.932962 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:12.933788 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:12.934748 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:12.964241 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a6604e92-f3b7-4e50-bc3d-ea85a96f7e7d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Jul 28 02:29:12.964784 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 521/1044] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:29:12 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:12.977093 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:12.977681 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:12.984171 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:12.984697 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:12.985530 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:12.985973 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:13.015170 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-40a08b76-af10-42a1-b64e-1e6b62806c13 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940" status: 200 len: 194 microversion: 2.1 time: 0.042943 Jul 28 02:29:13.015757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 524/1045] 10.222.0.40 () {58 vars in 1413 bytes} [Thu Jul 28 02:29:12 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:14.360714 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a4d1b8-afcb-4cad-a694-4819302c4f02"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:29:14.363027 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:14.369184 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:14.369632 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:14.370391 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:14.370821 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:14.612117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a65384ae-5d90-42dc-8f74-7b4d928d609a tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "POST /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255569 Jul 28 02:29:14.612728 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 522/1046] 10.222.0.40 () {60 vars in 1323 bytes} [Thu Jul 28 02:29:14 2022] POST /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:21.101737 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:21.103885 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:21.111085 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.111536 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.112302 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.112740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.144234 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09e20813-8997-4f71-b140-6ae07fdf4b20 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046292 Jul 28 02:29:21.144714 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 525/1047] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:29:21 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:21.282234 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:21.282804 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:21.289782 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.290230 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.290980 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.291411 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.320395 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c1de8737-f8d8-46f1-9f2a-ba8d323152ce tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940" status: 200 len: 194 microversion: 2.1 time: 0.042620 Jul 28 02:29:21.320978 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 523/1048] 10.222.0.40 () {58 vars in 1413 bytes} [Thu Jul 28 02:29:21 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:21.331757 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:21.332249 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:21.338301 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.338755 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.339517 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:21.339953 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:21.422842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lazy-loading 'services' on Instance uuid 1e654d8e-747e-43d4-815c-74e0c5fc162a {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:29:21.497142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3a39b8ac-9bd1-4b31-98bf-902fcff224ad tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940" status: 202 len: 0 microversion: 2.1 time: 0.169288 Jul 28 02:29:21.497946 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 526/1049] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:29:21 2022] DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/f5cdb2cc-5b80-4952-bca8-838090a19940 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:22.619551 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:22.620067 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:22.627676 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:22.628127 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:22.628940 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:22.629376 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:22.657890 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-516f05d6-17fb-4c05-9300-9c48b17d548c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/d3a4d1b8-afcb-4cad-a694-4819302c4f02" status: 200 len: 194 microversion: 2.1 time: 0.042250 Jul 28 02:29:22.658467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 524/1050] 10.222.0.40 () {58 vars in 1413 bytes} [Thu Jul 28 02:29:22 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/d3a4d1b8-afcb-4cad-a694-4819302c4f02 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:22.669614 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:22.670187 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:22.677287 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:22.677735 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:22.678501 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:22.678937 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:22.758874 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lazy-loading 'services' on Instance uuid 1e654d8e-747e-43d4-815c-74e0c5fc162a {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 02:29:22.830183 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5309885f-83ef-4852-b870-c1a21489a45d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/d3a4d1b8-afcb-4cad-a694-4819302c4f02" status: 202 len: 0 microversion: 2.1 time: 0.165114 Jul 28 02:29:22.831016 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 527/1051] 10.222.0.40 () {58 vars in 1416 bytes} [Thu Jul 28 02:29:22 2022] DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments/d3a4d1b8-afcb-4cad-a694-4819302c4f02 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:23.997820 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:24.000002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:24.006510 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.006961 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.007729 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.008168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.036900 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-49d11353-8df5-4259-9523-3b2f032fc3d0 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043037 Jul 28 02:29:24.037461 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 525/1052] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:29:23 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:29:24.158539 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:24.160922 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:24.167142 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.167590 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.168353 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.168789 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.196677 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-30d662a7-e025-428f-9934-15ebe0c7c26d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043605 Jul 28 02:29:24.197253 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 528/1053] 10.222.0.40 () {58 vars in 1302 bytes} [Thu Jul 28 02:29:24 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 02:29:24.258339 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:24.258827 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:24.265559 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.266002 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.266753 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.267183 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.291983 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 02:29:24.368001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd455055-4919-4994-a0e2-c4cca4bfb4fc tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 204 len: 0 microversion: 2.1 time: 0.112921 Jul 28 02:29:24.368794 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 526/1054] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:29:24 2022] DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 02:29:24.376903 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:24.377517 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:24.383457 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.383904 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.384661 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:24.385184 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:24.516992 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:29:24.524396 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ec43bb5-5941-4507-8f6a-f86f2f1ebd4c tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1673 microversion: 2.1 time: 0.151442 Jul 28 02:29:24.524983 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 529/1055] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:24 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 02:29:25.546698 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:25.547386 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:25.553762 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:25.554204 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:25.554950 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:25.555379 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:25.688248 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:29:25.695747 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d97f9f33-27f8-4ac0-a2b6-a9d235fa24fd tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1673 microversion: 2.1 time: 0.153792 Jul 28 02:29:25.696294 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 527/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:25 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:29:26.716888 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:26.717551 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:26.724149 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:26.724604 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:26.725408 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:26.725843 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:26.789284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cec16b821114fc0aa47e8549cacd7d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96bfb8cb74ca4919897cf243daafbe2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 02:29:26.796902 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-910df18f-0113-490d-b69c-c10af66c4f10 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 200 len: 1606 microversion: 2.1 time: 0.083909 Jul 28 02:29:26.797593 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 530/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:26 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 02:29:27.105450 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-83b5b5a7-5e9d-4a5b-8d0a-8cea794a3be3 req-52da5ffb-74cb-4370-b2fc-4246931556c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e654d8e-747e-43d4-815c-74e0c5fc162a", "name": "network-vif-deleted", "tag": "7c4645ae-8832-48dd-a8a3-d5e442eab360"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:29:27.117792 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83b5b5a7-5e9d-4a5b-8d0a-8cea794a3be3 req-52da5ffb-74cb-4370-b2fc-4246931556c6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:27.118237 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83b5b5a7-5e9d-4a5b-8d0a-8cea794a3be3 req-52da5ffb-74cb-4370-b2fc-4246931556c6 service nova] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:27.132005 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-83b5b5a7-5e9d-4a5b-8d0a-8cea794a3be3 req-52da5ffb-74cb-4370-b2fc-4246931556c6 service nova] Creating event network-vif-deleted:7c4645ae-8832-48dd-a8a3-d5e442eab360 for instance 1e654d8e-747e-43d4-815c-74e0c5fc162a on hv-cinder-79987 Jul 28 02:29:27.136830 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-83b5b5a7-5e9d-4a5b-8d0a-8cea794a3be3 req-52da5ffb-74cb-4370-b2fc-4246931556c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268713 Jul 28 02:29:27.137467 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 528/1058] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 28 02:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:27.819620 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:27.820252 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:27.826887 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:27.827384 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:27.828198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:27.828580 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:27.844005 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a HTTP/1.1 Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:29:27.845729 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:27.847217 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '1e654d8e-747e-43d4-815c-74e0c5fc162a'} Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:27.848262 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:27.850367 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:27.851862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:27.851862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e448818a-5009-4d99-b7d9-4e4b2e2977c7 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 404 len: 111 microversion: 2.1 time: 0.031483 Jul 28 02:29:27.851862 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 531/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:27 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:27.856649 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4237689f-c9d3-4beb-97ad-c4f3c7d63144 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '.version_select at 0x7efc52d30d30>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:27.886705 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4237689f-c9d3-4beb-97ad-c4f3c7d63144 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-819470566" status: 202 len: 0 microversion: 2.1 time: 0.034176 Jul 28 02:29:27.887280 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 529/1060] 10.222.0.40 () {58 vars in 1218 bytes} [Thu Jul 28 02:29:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-819470566 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:30.761250 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:30.761734 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:30.768179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:30.768630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:30.769432 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:30.769845 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:30.783485 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a HTTP/1.1 Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:29:30.785107 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.786741 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '1e654d8e-747e-43d4-815c-74e0c5fc162a'} Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:30.787601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.789203 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.790717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:30.790717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc5c0efc-8475-40c2-bed5-19a8883c1977 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 404 len: 111 microversion: 2.1 time: 0.029046 Jul 28 02:29:30.790717 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 532/1061] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:29:30 2022] DELETE /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:30.794951 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:30.796306 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: 1e654d8e-747e-43d4-815c-74e0c5fc162a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:30.803517 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:30.803968 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:30.804732 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:30.805195 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:30.818236 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a HTTP/1.1 Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:29:30.819859 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.821612 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '1e654d8e-747e-43d4-815c-74e0c5fc162a'} Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:30.822544 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. Jul 28 02:29:30.824072 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:30.825637 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance 1e654d8e-747e-43d4-815c-74e0c5fc162a could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:30.825637 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cdb6a744-908f-431d-b3b4-16681f39d536 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a" status: 404 len: 111 microversion: 2.1 time: 0.030254 Jul 28 02:29:30.825637 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 530/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:30 2022] GET /compute/v2.1/servers/1e654d8e-747e-43d4-815c-74e0c5fc162a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:31.961795 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:31.962268 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:31.969548 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:31.970001 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:31.970769 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:31.971204 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:31.986041 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 HTTP/1.1 Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:29:31.987572 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: > Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:31.989229 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': 'bb7852b5-c448-4c73-8090-8c75c15d6900'} Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:31.990068 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:31.991740 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:31.993426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:31.993426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5c5eef9a-7eb0-4f51-9696-5b3f37e76a49 tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 404 len: 111 microversion: 2.1 time: 0.031126 Jul 28 02:29:31.993426 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 533/1063] 10.222.0.40 () {58 vars in 1239 bytes} [Thu Jul 28 02:29:31 2022] DELETE /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:31.997237 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:31.997849 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] [instance: bb7852b5-c448-4c73-8090-8c75c15d6900] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 02:29:32.005168 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:32.005616 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:32.006370 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 02:29:32.006802 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Lock "40ba2639-484f-4689-bebf-4db6b384942b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 02:29:32.021774 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] HTTP exception thrown: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Request method failure captured: Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 HTTP/1.1 Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fOHUJbJdlJxQDcJj9hgmuoW9rvBeZHVl3qCXfuuGXMAq-yjmE4Rvchizjf-CE0oo3FaykvaGQxLKhRaSa0ijFkWAG6VH8jjlJXVV7bQN0T_M8OdZ2zc5fAT0s2z15Xif-ge61U3YKR-5BcHGMCp_86AiSNx8G8BvALa4e5_uxPBcRQ Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:29:32.023297 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_96bfb8cb74ca4919897cf243daafbe2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 96bfb8cb74ca4919897cf243daafbe2f Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1583202076 Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 8cec16b821114fc0aa47e8549cacd7d0 Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1583202076-project Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: > Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:32.024967 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': 'bb7852b5-c448-4c73-8090-8c75c15d6900'} Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:32.025986 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. Jul 28 02:29:32.027516 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:32.028860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] Returning 404 to user: Instance bb7852b5-c448-4c73-8090-8c75c15d6900 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:32.028860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c6f2d905-6766-4dbf-a01d-7d30c0ef247d tempest-AttachVolumeTestJSON-1583202076 tempest-AttachVolumeTestJSON-1583202076-project] 10.222.0.40 "GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900" status: 404 len: 111 microversion: 2.1 time: 0.031161 Jul 28 02:29:32.028860 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 531/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Thu Jul 28 02:29:31 2022] GET /compute/v2.1/servers/bb7852b5-c448-4c73-8090-8c75c15d6900 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:36.626972 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7c8f3dea-e09c-4290-a524-c2ea95756c52 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Action: 'create', calling method: .version_select at 0x7efc52e88700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1231678829"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:29:36.919710 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7c8f3dea-e09c-4290-a524-c2ea95756c52 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.403567 Jul 28 02:29:36.920936 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 534/1065] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 28 02:29:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 02:29:36.932843 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b0b1072c-cccc-47dc-96c8-b7c297dec8f5 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52bcd1f0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:36.987366 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b0b1072c-cccc-47dc-96c8-b7c297dec8f5 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 200 len: 345 microversion: 2.1 time: 0.058134 Jul 28 02:29:36.988373 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 532/1066] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:29:36 2022] GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:38.002629 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9d00909c-1e37-4df0-9d63-94af225556e8 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52ee33a0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:38.050223 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9d00909c-1e37-4df0-9d63-94af225556e8 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 200 len: 346 microversion: 2.1 time: 0.052373 Jul 28 02:29:38.050783 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 535/1067] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:29:37 2022] GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:38.064454 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-26774f88-211e-46a7-a935-2834fe2ce461 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Action: 'create', calling method: .version_select at 0x7efc52b7e4c0>, body: {"snapshot": {"volume_id": "01274c06-264e-4cf4-abd3-4ab2e735fa4e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1477065188"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 02:29:38.227933 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-26774f88-211e-46a7-a935-2834fe2ce461 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.168731 Jul 28 02:29:38.228583 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 533/1068] 10.222.0.40 () {60 vars in 1162 bytes} [Thu Jul 28 02:29:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:38.239505 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8aaaec19-33b1-467b-8f0d-6df645ad1f27 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc580c7550>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:38.272935 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8aaaec19-33b1-467b-8f0d-6df645ad1f27 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 287 microversion: 2.1 time: 0.037260 Jul 28 02:29:38.273533 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 536/1069] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:38 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:38.285288 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4f740126-63bd-4700-894a-69695f24b975 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52bd5af0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:38.315117 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4f740126-63bd-4700-894a-69695f24b975 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033552 Jul 28 02:29:38.315665 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 534/1070] 10.222.0.40 () {58 vars in 1140 bytes} [Thu Jul 28 02:29:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:38.326788 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df3b3a73-0738-4a58-a994-d6a6e5b30048 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52c80a60>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:38.355962 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df3b3a73-0738-4a58-a994-d6a6e5b30048 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 287 microversion: 2.1 time: 0.033363 Jul 28 02:29:38.356511 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 537/1071] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:38 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:39.111027 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:29:39.111600 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Thu Jul 28 02:29:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:29:39.368880 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-116b014f-207e-4c40-a781-221cf741748d tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52b76ca0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:39.399050 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-116b014f-207e-4c40-a781-221cf741748d tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 287 microversion: 2.1 time: 0.034462 Jul 28 02:29:39.399591 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 535/1072] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:39 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:40.412569 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57775b95-b5ed-497e-8ff4-c0c774457121 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc580c7310>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:40.441895 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57775b95-b5ed-497e-8ff4-c0c774457121 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 287 microversion: 2.1 time: 0.033612 Jul 28 02:29:40.442454 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 538/1073] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:40 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:41.455069 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a67fe253-9667-4ab6-8988-d6171724cbbd tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc5925ff70>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:41.484191 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a67fe253-9667-4ab6-8988-d6171724cbbd tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 288 microversion: 2.1 time: 0.033686 Jul 28 02:29:41.484740 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 536/1074] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:41 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:41.496001 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e0029521-5b9d-4e70-96ee-2184a066147d tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52e88280>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:41.552198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e0029521-5b9d-4e70-96ee-2184a066147d tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 202 len: 0 microversion: 2.1 time: 0.060338 Jul 28 02:29:41.553179 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 539/1075] 10.222.0.40 () {58 vars in 1254 bytes} [Thu Jul 28 02:29:41 2022] DELETE /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:41.561908 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c2b144e-6bc9-4fec-bca6-4d0c31b779c1 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52d30dc0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:41.590527 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c2b144e-6bc9-4fec-bca6-4d0c31b779c1 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 200 len: 287 microversion: 2.1 time: 0.033100 Jul 28 02:29:41.591095 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 537/1076] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:41 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:42.600198 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=22 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:42.600997 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:42.605228 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3214e797-c645-45ca-ae13-c47c099a20ef tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52cc59d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:42.632088 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-3214e797-c645-45ca-ae13-c47c099a20ef tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] HTTP exception thrown: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3214e797-c645-45ca-ae13-c47c099a20ef tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Request method failure captured: Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 HTTP/1.1 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fSQpa4dzfRU3jXAf3jPzvnV7vrFa5ihMb7kvUU94l0R_Zs3PFxZqmLsdVaswF9g-VZ1dktXDbyJj9tZACdJ5UNPxwg_qa-_nfauc7rK2ezQizhHP6XUOUDj02E8TT9TaRzcxDCnYFj_aCRebN8q6bbjSRFAzc9nqzUuofOFnwgfskY Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:29:42.634391 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 7342a3bf31484e4ba0d7156ea72d926b Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '3a726591-0a89-4adf-ae8d-ed23449e2dd9'} Jul 28 02:29:42.636130 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. (HTTP 404) (Request-ID: req-2626dbd7-1423-4200-b991-e8329ae60a30) Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.637283 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:42.639381 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 02:29:42.640894 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3214e797-c645-45ca-ae13-c47c099a20ef tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Returning 404 to user: Snapshot 3a726591-0a89-4adf-ae8d-ed23449e2dd9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:42.642573 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3214e797-c645-45ca-ae13-c47c099a20ef tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9" status: 404 len: 111 microversion: 2.1 time: 0.036596 Jul 28 02:29:42.644046 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 540/1077] 10.222.0.40 () {58 vars in 1251 bytes} [Thu Jul 28 02:29:42 2022] GET /compute/v2.1/os-snapshots/3a726591-0a89-4adf-ae8d-ed23449e2dd9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:42.644147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:42.644147 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 02:29:42.647161 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4d620b31-6388-4e4f-88b6-49c1bfa08411 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52c2f280>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:42.711006 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4d620b31-6388-4e4f-88b6-49c1bfa08411 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 202 len: 0 microversion: 2.1 time: 0.069926 Jul 28 02:29:42.711710 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 538/1078] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:29:42 2022] DELETE /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 02:29:42.721271 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-719c1be3-ce4b-4279-ac7e-d7618bca8a06 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52e88040>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:42.769601 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-719c1be3-ce4b-4279-ac7e-d7618bca8a06 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 200 len: 345 microversion: 2.1 time: 0.052319 Jul 28 02:29:42.770189 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 541/1079] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:29:42 2022] GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 02:29:43.783457 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10948db4-a21a-433c-ae0b-0e4c009d2105 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52bcd4c0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:43.811378 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-10948db4-a21a-433c-ae0b-0e4c009d2105 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] HTTP exception thrown: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10948db4-a21a-433c-ae0b-0e4c009d2105 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Request method failure captured: Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e HTTP/1.1 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fSQpa4dzfRU3jXAf3jPzvnV7vrFa5ihMb7kvUU94l0R_Zs3PFxZqmLsdVaswF9g-VZ1dktXDbyJj9tZACdJ5UNPxwg_qa-_nfauc7rK2ezQizhHP6XUOUDj02E8TT9TaRzcxDCnYFj_aCRebN8q6bbjSRFAzc9nqzUuofOFnwgfskY Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:29:43.813359 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 7342a3bf31484e4ba0d7156ea72d926b Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '01274c06-264e-4cf4-abd3-4ab2e735fa4e'} Jul 28 02:29:43.815001 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. (HTTP 404) (Request-ID: req-cee2b990-9e64-48c0-ada9-b55b4fc76a4c) Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.815919 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:43.817422 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 02:29:43.818832 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10948db4-a21a-433c-ae0b-0e4c009d2105 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Returning 404 to user: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-10948db4-a21a-433c-ae0b-0e4c009d2105 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 404 len: 109 microversion: 2.1 time: 0.035662 Jul 28 02:29:43.820283 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 539/1080] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:29:43 2022] GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:43.829284 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dbf749df-07f3-4561-95c9-2bef4be1ccc9 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52cc55e0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:43.856124 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-dbf749df-07f3-4561-95c9-2bef4be1ccc9 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] HTTP exception thrown: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dbf749df-07f3-4561-95c9-2bef4be1ccc9 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Request method failure captured: Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e HTTP/1.1 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Connection: close Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Host: 10.222.0.40 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABi4fSQpa4dzfRU3jXAf3jPzvnV7vrFa5ihMb7kvUU94l0R_Zs3PFxZqmLsdVaswF9g-VZ1dktXDbyJj9tZACdJ5UNPxwg_qa-_nfauc7rK2ezQizhHP6XUOUDj02E8TT9TaRzcxDCnYFj_aCRebN8q6bbjSRFAzc9nqzUuofOFnwgfskY Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 28 02:29:43.858630 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Id: 7342a3bf31484e4ba0d7156ea72d926b Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: method: Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: exception: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: action_args: {'id': '01274c06-264e-4cf4-abd3-4ab2e735fa4e'} Jul 28 02:29:43.860270 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. (HTTP 404) (Request-ID: req-ed4688ef-928c-44b0-a801-1b425f19f541) Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.861363 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 02:29:43.862842 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 02:29:43.864314 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dbf749df-07f3-4561-95c9-2bef4be1ccc9 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Returning 404 to user: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:43.865882 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dbf749df-07f3-4561-95c9-2bef4be1ccc9 tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 404 len: 109 microversion: 2.1 time: 0.035113 Jul 28 02:29:43.866960 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 542/1081] 10.222.0.40 () {58 vars in 1248 bytes} [Thu Jul 28 02:29:43 2022] DELETE /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 02:29:43.868419 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b87144f9-fb5c-4b90-83b4-0dee3737b8ba tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Calling method '.version_select at 0x7efc52c2fb80>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 02:29:43.896435 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-b87144f9-fb5c-4b90-83b4-0dee3737b8ba tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] HTTP exception thrown: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b87144f9-fb5c-4b90-83b4-0dee3737b8ba tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Request method failure captured: Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e HTTP/1.1 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Connection: close Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Host: 10.222.0.40 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.10 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABi4fSQpa4dzfRU3jXAf3jPzvnV7vrFa5ihMb7kvUU94l0R_Zs3PFxZqmLsdVaswF9g-VZ1dktXDbyJj9tZACdJ5UNPxwg_qa-_nfauc7rK2ezQizhHP6XUOUDj02E8TT9TaRzcxDCnYFj_aCRebN8q6bbjSRFAzc9nqzUuofOFnwgfskY Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 28 02:29:43.898402 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e1dbec999daa4ad6889020bc3a8fc6f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e1dbec999daa4ad6889020bc3a8fc6f2 Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1110450449 Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Id: 7342a3bf31484e4ba0d7156ea72d926b Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1110450449-project Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: method: Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: exception: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: action_args: {'id': '01274c06-264e-4cf4-abd3-4ab2e735fa4e'} Jul 28 02:29:43.900011 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. (HTTP 404) (Request-ID: req-0f197f87-bd68-47e0-95a1-ee991fdca6cb) Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.901017 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 02:29:43.902482 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 02:29:43.905228 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b87144f9-fb5c-4b90-83b4-0dee3737b8ba tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] Returning 404 to user: Volume 01274c06-264e-4cf4-abd3-4ab2e735fa4e could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b87144f9-fb5c-4b90-83b4-0dee3737b8ba tempest-VolumesSnapshotsTestJSON-1110450449 tempest-VolumesSnapshotsTestJSON-1110450449-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e" status: 404 len: 109 microversion: 2.1 time: 0.035166 Jul 28 02:29:43.907152 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 540/1082] 10.222.0.40 () {58 vars in 1245 bytes} [Thu Jul 28 02:29:43 2022] GET /compute/v2.1/os-volumes/01274c06-264e-4cf4-abd3-4ab2e735fa4e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 02:31:27.896933 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:31:27.897483 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:31:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:31:37.142996 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:31:37.143669 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:31:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:31:53.877259 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:31:53.877892 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Thu Jul 28 02:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:31:54.531732 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:31:54.532291 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:32:59.119098 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:32:59.119735 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Thu Jul 28 02:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:34:47.904586 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:34:47.905254 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:34:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:34:57.152787 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:34:57.153610 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:34:58.089898 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:34:58.091229 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Thu Jul 28 02:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:35:13.884828 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:35:13.885543 dv-cinder-799871-46-iscsi devstack@n-api.service[117788]: Thu Jul 28 02:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 02:35:14.540520 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 02:35:14.541100 dv-cinder-799871-46-iscsi devstack@n-api.service[117787]: Thu Jul 28 02:35:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!